DigitalMANIPULATIVE
AI-Translated Localization
What it is
Using machine translation and language models to run one covert campaign in many languages at once, with copy fluent enough to pass as locally written, while hiding that it originates elsewhere.
How it works
Real-world examples
- •OpenAI's May 2024 report said the Russian operation Doppelganger and the Chinese operation Spamouflage used its models to correct grammar and to create short comments in a range of languages, and that people acting for Iran's IUVM generated and proofread articles in English and French.
- •Microsoft's Threat Analysis Center reported in April 2024 that Storm-1376, its name for the network commonly called Spamouflage or Dragonbridge, spans more than 175 websites and 58 languages.
- •The U.S. Justice Department said in July 2024 that the Russian Meliorator bot farm targeted audiences in the United States, Poland, Germany, the Netherlands, Spain, Ukraine, and Israel.
- •OpenAI said it dubbed one Russia-origin network Bad Grammar for its focus on Telegram, its repeated posting of ungrammatical English, and its struggle to build an audience, a reminder that the tools do not guarantee polish.
Ethical guidelines
- ●Translation itself is benign and valuable. The deception is posing as a local voice while concealing a foreign or paid origin.
- ●Governments and companies that communicate abroad can do so openly under their own names; disclosed public diplomacy is not an influence operation.
- ●Do not treat imperfect language as proof of bad faith. Most people who write awkwardly in your language are immigrants, learners, or tourists.
How to defend against it
- ►Drop the old heuristic that good grammar means a genuine local. Check instead for local knowledge that is hard to fake: specific places, recent local events, the platforms people in that place actually use.
- ►Look at the account's language history. A persona that posted in three unrelated languages, or switched language abruptly, is worth a second look.
- ►Search for the same talking point in other languages. Identical arguments appearing at once across several countries suggest a central source.
- ►Read laterally: check whether established local outlets are covering the claim at all.
- ►Know the limit: a well-run localized persona may be indistinguishable from text alone. Weight claims by their sourcing, not by the apparent nationality of whoever repeats them.
References
- OpenAI (2024). AI and Covert Influence Operations: Latest Trends. OpenAI threat intelligence report, May 30, 2024 · linkUse of models for translation, proofreading, and multilingual comments by Doppelganger, Spamouflage, and IUVM, and the finding that volume did not translate into authentic engagement.
- Microsoft Threat Analysis Center (2024). Same targets, new playbooks: East Asia threat actors employ unique methods. Microsoft Security Insider, April 2024 · linkStorm-1376 operating across more than 175 websites and 58 languages.
- U.S. Department of Justice, Office of Public Affairs (2024). Justice Department Leads Efforts Among Federal, International, and Private Sector Partners to Disrupt Covert Russian Government-Operated Social Media Bot Farm. Press release, July 9, 2024 · linkThe list of countries targeted by the Meliorator bot farm.
Last reviewed
Suggest a correctionRelated Articles
Dark Patterns in UX: How Apps Manipulate Your Behavior
Subscription traps, misleading interfaces, and engineered addiction. Understanding the persuasion techniques built into the apps you use every day.
7 min read
OSINT for Beginners: Open Source Intelligence Explained
Open Source Intelligence (OSINT) uses publicly available data to gather actionable insights. Here is a beginner-friendly guide to what OSINT is and how it is used.
10 min read