Hacker News
A Science Policy Forum warns that coordinated fleets of AI-driven personas, termed 'AI swarms,' could manufacture the appearance of public agreement at scale, posing a threat to democratic discourse by counterfeiting social proof and consensus.
AI 生成摘要
科學政策論壇警告，由AI驅動的協調性虛擬人物群體，即「AI蜂群」，能夠大規模製造公眾認同的假象，透過偽造社會認同和共識，威脅民主討論。
Science Policy Forum warns that malicious AI “swarms” could fake public consensus
[Image blocked: Image]
Connected world: As the sun sets and the streets quiet down, social networks remain active. But it's not just real people who can be found on social networks—there are also clones and artificially generated profiles.
© Adobe Stock
A new Science Policy Forum article warns that the next generation of influence operations may not look like obvious “copy-paste bots,” but like coordinated communities: fleets of AI-driven personas that can adapt in real time, infiltrate groups, and manufacture the appearance of public agreement at scale. In this week’s journal, the authors describe how the fusion of large language models (LLMs) with multi-agent systems could enable “malicious AI swarms” that imitate authentic social dynamics—and threaten democratic discourse by counterfeiting social proof and consensus.
The article argues that the central risk is not only false content, but synthetic consensus: the illusion that “everyone is saying this,” which can influence beliefs and norms even when individual claims are contested. This risk compounds existing vulnerabilities in online information ecosystems shaped by engagement-driven platform incentives, fragmented audiences, and declining trust.
A malicious AI swarm is a network of AI-controlled agents that can hold persistent identities and memory; coordinate toward shared objectives while varying tone and content; adapt to engagement and human responses; operate with minimal oversight; and deploy across platforms. Operating with minimal oversight and spreading across platforms, these systems can generate diverse, context-aware content that still moves in lockstep—making them far more difficult to detect than traditional botnets.
"In our research during COVID-19, we observed misinformation race across borders as quickly as the virus itself. AI swarms capable of manufacturing synthetic consensus could push this threat into an even more dangerous realm.”, says Meeyoung Cha, a scientific director at the Max Planck Institute for Security and Privacy in Bochum.
Instead of moderating posts one by one, the authors argue for defenses that track coordinated behavior and content provenance: detect statistically unlikely coordination (with transparent audits), perform stress tests for social media platforms via simulations, offer privacy-preserving verification options, and share evidence through a distributed AI Influence Observatory—while also reducing incentives by limiting monetization of inauthentic engagement and increasing accountability.
[Image blocked: Image]
A look back at a year of research with many highlights
[Image blocked: Image]
Field experiment on Reddit examines what distinguishes passive from active users and tests interventions designed to get more people to join the conversation
[Image blocked: Image]
Carmela Troncoso explains problems with voluntary Chat Control and mandatory age verification proposed by the European Council
[Image blocked: Image]
New Max Planck Center brings together researchers from Freiburg and Jerusalem
[Image blocked: Image]
Political scientist Ursula Daxecker and sociologist Steffen Mau have been appointed to the Max Planck Institute for the Study of Religious and Ethnic Diversity in Göttingen. The new appointments mark the beginning of the Institute's strategic realignment
[Image blocked: Image]
Surveys in the US and the UK on attitudes toward automated decision-making processes in the allocation of social benefits
[Image blocked: Image]
How Political Narratives are distributed on Twitter/X
[Image blocked: Image]
When people delegated tasks to machine agents–whether voluntarily or in a forced manner–they were more likely to cheat
[Image blocked: Image]
AI can assist early warning systems that predict impacts of extreme weather events such as droughts and heavy rainfall
[Image blocked: Image]
While humans concentrate on the meaning of objects, artificial intelligence focuses on visual characteristics
[Image blocked: Image]
New Study Compares the Creative Processes of Humans and Large Language Models
[Image blocked: Image]
Researchers have used spatial Deep Visual Proteomics workflow to reveal why some patients with the hereditary disease remain healthy
2026, Max-Planck-Gesellschaft
© 2003-2026, Max-Planck-Gesellschaft