"OpenAI Uncovers Evidence of A.I.-Powered Chinese Surveillance Tool" 24 February 2025

OpenAI said on Friday that it had uncovered evidence that a Chinese security operation had built an artificial intelligence-powered surveillance tool to gather real-time reports about anti-Chinese posts on social media services in Western countries.

The company’s researchers said they had identified this new campaign, which they called Peer Review...

Ben Nimmo, a principal investigator for OpenAI, said this was the first time the company had uncovered an A.I.-powered surveillance tool of this kind...

There have been growing concerns that A.I. can be used for surveillance, computer hacking, disinformation campaigns and other malicious purposes. Though researchers like Mr. Nimmo say the technology can certainly enable these kinds of activities, they add that A.I. can also help identify and stop such behavior.

Mr. Nimmo and his team believe the Chinese surveillance tool is based on Llama, an A.I. technology built by Meta, which open sourced its technology, meaning it shared its work with software developers across the globe.

In a detailed report on the use of A.I. for malicious and deceptive purposes, OpenAI also said it had uncovered a separate Chinese campaign, called Sponsored Discontent, that used OpenAI’s technologies to generate English-language posts that criticized Chinese dissidents.

The same group, OpenAI said, has used the company’s technologies to translate articles into Spanish before distributing them in Latin America. The articles criticized U.S. society and politics...

Separately, OpenAI researchers identified a campaign, believed to be based in Cambodia, that used the company’s technologies to generate and translate social media comments that helped drive a scam known as “pig butchering,” the report said...