News

OpenAI unveils voice-cloning tool

By AFP

March 30, 2024 09:24 AM


Representational image

OpenAI on Friday revealed a voice-cloning tool it plans to keep tightly controlled until safeguards are in place to thwart audio fakes meant to dupe listeners.

A model called "Voice Engine" can essentially duplicate someone's speech based on a 15-second audio sample, according to an OpenAI blog post sharing results of a small-scale test of the tool.

"We recognize that generating speech that resembles people's voices has serious risks, which are especially top of mind in an election year," the San Francisco-based company said.

"We are engaging with U.S. and international partners from across government, media, entertainment, education, civil society and beyond to ensure we are incorporating their feedback as we build."

Disinformation researchers fear rampant misuse of AI-powered applications in a pivotal election year thanks to proliferating voice cloning tools, which are cheap, easy to use and hard to trace.

Acknowledging these problems, OpenAI said it was "taking a cautious and informed approach to a broader release due to the potential for synthetic voice misuse."

The cautious unveiling came a few months after a political consultant working for the long-shot presidential campaign of a Democratic rival to Joe Biden admitted being behind a robocall impersonating the US leader.

The AI-generated call, the brainchild of an operative for Minnesota congressman Dean Phillips, featured what sounded like Biden's voice urging people not to cast ballots in January's New Hampshire primary.

https://www.youtube.com/watch?v=1ec-jOlxt_E

The incident caused alarm among experts who fear a deluge of AI-powered deepfake disinformation in the 2024 White House race as well as in other key elections around the globe this year.

OpenAI said that partners testing Voice Engine agreed to rules including requiring explicit and informed consent of any person whose voice is duplicated using the tool.

It must also be made clear to audiences when voices they are hearing are AI generated, the company added.

"We have implemented a set of safety measures, including watermarking to trace the origin of any audio generated by Voice Engine, as well as proactive monitoring of how it's being used," OpenAI said.


AFP


Most Read

  1. Farmers can apply for Bardana through App from Saturday as Punjab starts wheat procurement campaign Farmers can apply for Bardana through App from Saturday as Punjab starts wheat procurement campaign
  2. Adil Raja loses pleas to dismiss Naseer’s defamation suits Adil Raja loses pleas to dismiss Naseer’s defamation suits
  3. Punjab students asked to get registered for getting petrol, e-bikes Punjab students asked to get registered for getting petrol, e-bikes
  4. Star woman cricketer Aliya Riaz ties the knot with Ali Younis in intimate Nikkah Ceremony Star woman cricketer Aliya Riaz ties the knot with Ali Younis in intimate Nikkah Ceremony
  5. ASF official who misbehaved with girl at Karachi airport likely to face music ASF official who misbehaved with girl at Karachi airport likely to face music
  6. Amir Tanba, linked to Indian spy Sarabjit Singh's jail killing, killed in Lahore Amir Tanba, linked to Indian spy Sarabjit Singh's jail killing, killed in Lahore

Opinion

  1. Insights into the Pakistan Stock Exchange's Recent Record High Triumph
    Insights into the Pakistan Stock Exchange's Recent Record High Triumph

    By Zulfiqar Ali Mir

  2. IMEC to sabotage CPEC
    IMEC to sabotage CPEC

    By Dr Asif Channer

  3. 1947 TO FORM 47
    1947 TO FORM 47

    By Dr Asif Channer

  4. Beijing wants to further highlight industrial sector in its country and take scientific innovation to new heights....
    Beijing wants to further highlight industrial sector in its country and take scientific innovation to new heights....

    By Ali Ramay

  5. Global race: China will reduce its unnecessary expenses
    Global race: China will reduce its unnecessary expenses

    By Ali Ramay

  6. Channer Pir: The Great Saint of Cholistan
    Channer Pir: The Great Saint of Cholistan

    By Dr Asif Channer