Prepare to be shocked: the world of online propaganda has a dirty little secret, and it's all about 'AI slop'!
You might think that with the rise of artificial intelligence, state-sponsored propaganda campaigns would be creating high-quality, convincing content. But a recent report by Graphika, a social media analytics company, has revealed a surprising truth.
The report analyzed nine ongoing influence operations, including those linked to China and Russia, and found that while these campaigns have embraced AI, the results are often far from impressive.
Here's where it gets controversial: despite the advanced nature of generative AI, the content produced by these campaigns is described as 'low-quality slop'. From awkward translations to synthetic news reporters that lack authenticity, the AI-generated material is failing to make an impact.
Graphika's researchers, including senior analyst Dina Sadek, found that while AI has streamlined certain campaign processes, the output is lacking in engagement and quality.
Sadek explains, 'Influence operations have integrated AI tools, but much of the content is low-quality and cheap. Despite this, they can still create a lot of content quickly and easily.'
One example cited is 'Doppelganger', an operation linked to the Kremlin, which used AI to create fake news websites. Another, 'Spamoflauge', tied to China, generates fake AI news influencers, but the videos lack conviction and fail to gain traction.
And this is the part most people miss: even if these campaigns don't reach a wide audience, they still serve a purpose in the age of AI chatbots. These chatbots are constantly learning and training, and by flooding the internet with content, propagandists can influence the data these chatbots use.
A study by the Institute for Strategic Dialogue supports this, finding that major AI chatbots often cite state-sponsored Russian news outlets in their responses.
So, while AI hasn't revolutionized online propaganda, it has made it easier to automate and scale.
What are your thoughts on this? Do you think the use of AI in propaganda campaigns will improve over time, or is this a sign of things to come? We'd love to hear your opinions in the comments!
