How AI Is Being Weaponized to Manipulate ChatGPT and Google Search Results Through Reddit

Summary

A new report reveals how marketers and spammers are increasingly using artificial intelligence to manipulate popular AI chatbots and search tools, with Reddit identified as a primary target for coordinated influence campaigns. Companies are systematically flooding subreddits like r/biohackers with sponsored content designed to be scraped by systems like ChatGPT and Google's AI search tools—a practice known as Generative AI-engine optimization (GEO) or AI-engine optimization (AEO). Marketing firms like RedRover openly advertise services deploying AI agents to mass-publish content across Reddit and other platforms to influence how AI systems recommend products and services.

What makes this spam particularly difficult to detect and remove is its sophistication: the accounts performing these operations maintain realistic posting histories, organic-seeming engagement patterns, and strategically timed brand mentions buried in high-traffic threads. While Reddit states it uses automated tooling and human review to combat such content, moderators report that the tactics have evolved faster than detection systems can adapt, increasingly requiring manual pattern recognition. The situation highlights a fundamental contradiction at Reddit: while actively combating AI-driven manipulation on its platform, the company has simultaneously struck licensing deals with AI companies, including OpenAI, to train their models on Reddit's user-generated content.

• Reddit faces a core contradiction: licensing its content to AI companies for training while struggling to prevent those same AI systems from being manipulated through its platform

Editorial Opinion

This report exposes a critical vulnerability in AI systems that demands urgent attention from both technology companies and regulators. As AI chatbots become trusted sources of information for millions, the ability to systematically poison their training data and manipulate their outputs represents a significant threat to information integrity and public trust. The sophistication of these tactics suggests that generic automated detection is inadequate—AI companies need to invest far more heavily in adversarial robustness and data integrity verification. Most importantly, companies building AI systems should be transparent about how they combat data poisoning and manipulation, rather than treating these threats as internal technical problems to be solved quietly.