Photo credit: www.engadget.com

Unauthorized AI Experiment on Reddit Raises Ethical Concerns

A recent investigation has revealed that a group of researchers conducted an extensive and unauthorized experiment within one of Reddit’s largest communities, using AI-generated comments to assess the influence of large language models (LLMs) on user opinions. Moderators of the subreddit r/changemyview described this action as a form of “psychological manipulation” directed at unsuspecting participants.

In a detailed announcement, the r/changemyview moderator team informed users about the experiment led by researchers from the University of Zurich. “This experiment deployed AI-generated comments to study how AI could be used to change views,” they stated.

The researchers utilized LLMs to craft responses to various posts on r/changemyview, a platform where members express often contentious opinions and seek diverse perspectives. Boasting a membership of 3.8 million, the subreddit frequently captures significant attention on Reddit’s front page. The moderators disclosed that the AI adopted different personas while engaging in discussions, including identities such as a sexual assault survivor, a trauma counselor, and a participant opposing racial justice movements. While many original comments from the experiment have been removed, some can still be accessed through an archive created by 404 Media.

In a draft of their research paper, the researchers outlined their methodology, which included tailoring AI responses based on personal details such as the original poster’s gender, age, ethnicity, location, and political beliefs derived from their posting history. “In addition to the post’s content, LLMs were provided with personal attributes of the OP…as inferred from their posting history using another LLM,” they explained.

The moderators of r/changemyview emphasized that the researchers breached several platform rules, notably a guideline that mandates transparency when AI is employed to generate content and a prohibition against using bots. They have since lodged a formal complaint with the University of Zurich and have requested that the research paper’s publication be put on hold.

On a broader scale, Reddit is contemplating potential legal actions regarding the incident. Chief Legal Officer Ben Lee expressed on Monday that the researchers’ actions were “deeply wrong on both a moral and legal level,” asserting that their conduct violated Reddit’s overarching policies.

Reddit has also banned accounts associated with this research initiative. In response to the incident, Ben Lee noted, “While we were able to detect many of these fake accounts, we will continue to improve our mechanisms for identifying inauthentic content and have collaborated with the moderation team to eliminate any AI-generated content linked to this research.”

In correspondence, the researchers from the University of Zurich deferred questions to their media relations department, which did not immediately reply. In their posts on Reddit and in their draft paper, the researchers claimed that their work obtained ethics committee approval and could contribute valuable insights for online communities like Reddit in guarding against more harmful applications of AI.

“We acknowledge the moderators’ position that this study was an unwelcome intrusion into your community, and we understand that some of you may feel uncomfortable that this experiment was conducted without prior consent,” the researchers conveyed in a follow-up comment. “We believe the potential benefits of this research substantially outweigh its risks.” They contended that the controlled study offered valuable information regarding the real-world persuasive abilities of LLMs, which are readily accessible and could be misused by malicious entities for more detrimental agendas such as election manipulation or inciting hatred.

The r/changemyview moderators countered that the necessity or innovation of the research was questionable, pointing to existing studies conducted by OpenAI that utilized data from their subreddit without infringing on the rights of non-consenting participants. “People do not come here to discuss their views with AI or to be experimented upon,” they argued. “Those who visit our subreddit deserve a space free from this type of intrusion.”

Update, April 28, 2025, 3:45 PM PT: This article has been updated with additional details from a statement made by Reddit’s Chief Legal Officer.

Source
www.engadget.com