DigitalDUAL-USE

Algorithmic Amplification

What it is

Platform algorithms that preferentially surface engaging content — which tends to be outrage-inducing, divisive, or sensational — creating distorted information environments.

How it works

Social media algorithms optimize for engagement metrics (likes, comments, shares, time-on-platform). Emotional, outrage-inducing, and tribal content generates the most engagement. The algorithm doesn't understand truth or value — it amplifies whatever keeps users scrolling, systematically biasing information environments toward extremity.

Real-world examples

  • •YouTube's recommendation algorithm sending viewers down increasingly extreme content rabbit holes.
  • •Facebook's news feed prioritizing posts that generate angry reactions.
  • •TikTok's algorithm creating filter bubbles within hours of account creation based on engagement patterns.

Historical case studies

Twitter's audit of its own timeline algorithm

2021Platform Research

Using a long-running experiment in which a randomly chosen one percent of users saw a purely chronological feed, researchers at Twitter measured how much the ranking algorithm amplified tweets from elected politicians in seven countries. In six of the seven, including the United States, the United Kingdom, Canada and France, the mainstream political right received more algorithmic amplification than the mainstream left; Germany was the exception. In the United States, right-leaning news outlets were also amplified more than left-leaning ones. The authors could not say why and found no evidence that the algorithm favoured the far left or far right over the mainstream. It remains one of the few cases in which a platform has published such a measurement.

Source →

Facebook in Myanmar

2013–2018Human Rights

For most people in Myanmar, Facebook arrived together with the mobile internet and effectively was the internet. Military personnel and nationalist monks used it to spread dehumanizing posts about the Rohingya Muslim minority in the years before the 2017 campaign of killing and expulsion, which UN investigators said bore the hallmarks of genocide; they described Facebook's role as "determining." An independent assessment commissioned by the company concluded in 2018 that it had not done enough to prevent the platform from being used to incite offline violence, and Facebook said it agreed. The assessment did not separate the effect of engagement-based ranking from that of scale and the near absence of Burmese-language moderation, and that question remains disputed.

Source →

Ethical guidelines

Where the line is

Ranking content by relevance is necessary for any large platform. It becomes manipulation when engagement is optimized in ways known to amplify outrage or falsehood, or when amplification is sold or applied without disclosure.

  • ●Platforms have a responsibility for the information environments their algorithms create.
  • ●Optimizing purely for engagement without considering societal harm is negligent.
  • ●Algorithmic transparency should be mandatory so users understand why they see what they see.

How to defend against it

  • ►Actively curate your feeds — follow diverse sources and unfollow accounts that trigger outrage.
  • ►Use chronological feeds when available instead of algorithmic ones.
  • ►Recognize that the content you see is selected to engage you, not to inform you.

From the Defense Playbook

Every playbook entry states how strong its evidence is and when not to use it. Browse the full playbook.

DISARM framework

How analysts would file this in the open DISARM framework (v1.6.1, CC BY-SA 4.0). Closest matches, mapped by Persuasion Lab.

T0121Manipulate Platform AlgorithmT0153.006Content Recommendation Algorithm

References

  1. Rathje, S., Van Bavel, J. J., & van der Linden, S. (2021). Out-group animosity drives engagement on social media. Proceedings of the National Academy of Sciences, 118(26), e2024292118
    The entry's claim that divisive, tribal content generates the most engagement: across millions of posts from news outlets and members of Congress, each additional out-group-referencing word roughly doubled the odds of a share, far more than positive or in-group language.
  2. Guess, A. M., Malhotra, N., Pan, J., Barberá, P., Allcott, H., Brown, T., Crespo-Tenorio, A., Dimmery, D., Freelon, D., Gentzkow, M., et al. (2023). How do social media feed algorithms affect attitudes and behavior in an election campaign?. Science, 381(6656), 398–404
    Honest calibration: switching Facebook and Instagram users to a chronological feed for three months changed what they saw (less content from like-minded sources, more political and untrustworthy content) but did not measurably change polarisation or political attitudes — so the entry's 'distorted information environment' claim is supported while the strong causal claim about beliefs is not.
Last reviewed
Suggest a correction

Detect Algorithmic Amplification in any text

Paste any message, email, or article into our free Manipulation Detector to see if Algorithmic Amplification or other techniques are being used on you.

Related Articles