OpenAI used this subreddit to test AI persuasion

OpenAI uses r/ChangeMyView to test AI's persuasive skills with its o3-mini model.

: OpenAI tested its AI reasoning model's persuasive abilities using the r/ChangeMyView subreddit. The AI wrote replies to user posts in a closed environment, and these were assessed by testers. Despite various challenges in acquiring datasets, OpenAI has had agreements like the one with Reddit to train its models. OpenAI aims to ensure AI doesn't become overly persuasive, which could be dangerous.

OpenAI utilized the Reddit subreddit r/ChangeMyView to test the persuasive abilities of its AI reasoning models, including its new o3-mini model. The content was collected through user posts where AI-generated replies were compared to human responses to evaluate persuasion skills.

While OpenAI's agreement with Reddit allows training on user posts, the ChangeMyView evaluation is reportedly separate from this deal. OpenAI's reasoning models, like o3-mini, perform in the top 80-90th percentile in persuasion abilities, demonstrating effectiveness, though there is no significant advancement over previous models.

The tests aim to ensure AI models do not become too persuasive, addressing concerns about AI potentially pursuing its own agenda. However, accessing high-quality datasets remains challenging, underscoring ongoing efforts to ethically obtain and use data for AI development.

AI testingPersuasiontechnology