OpenAI Leadership Split Over In-House AI Watermarking Technology

Security

OpenAI has a tool to automatically watermark AI-generated content, but company leadership is split on whether to release it to the public.

According to The Wall Street Journal, the company behind ChatGPT started developing a tool capable of labeling content generated by its large language models (LLMs) two years ago.

People familiar with the matter told the US news outlet that the tool works by slightly changing how the tokens are selected, similar to how Google’s SynthID for Text works.

 Those changes would leave a pattern called a watermark.

According to internal documents, the watermarks created by OpenAI’s in-house tool are 99.9% effective when enough new text is created by ChatGPT.

The tool is allegedly ready to be released, but the project has been mired in internal debate for two years.

One primary concern is that the tool might turn ChatGPT users away from the product.

An April 2023 survey the company conducted with loyal ChatGPT users found nearly a third would be turned off by the technology, mainly because it could detect cheating and plagiarism.

Photo credit: Daniel Chetroni/Shutterstock

Read more: OpenAI Announces Plans to Combat Misinformation Amid 2024 Elections
 

Products You May Like

Articles You May Like

AI security bubble already springing leaks
Malicious Actors Spreading False US Voter Registration Breach Claims
Apple Vision Pro Vulnerability Exposed Virtual Keyboard Inputs to Attackers
Record $65m Settlement for Hacked Patient Photos
CosmicBeetle joins the ranks of RansomHub affiliates – Week in security with Tony Anscombe

Leave a Reply

Your email address will not be published. Required fields are marked *