DigitalDUAL-USE

Data-Driven Persuasion Profiling

What it is

Using behavioral data to build individual psychological profiles that identify each person's specific persuasion vulnerabilities.

How it works

Your online behavior reveals your personality traits, emotional state, cognitive biases, and persuasion susceptibility. Likes, shares, browsing time, scroll speed, and purchase patterns are fed into models that predict what kind of appeal will work on you specifically: fear vs. aspiration, scarcity vs. social proof, authority vs. peer pressure. Each person is matched with their weakness.

Real-world examples

  • •Social media platforms inferring depression from usage patterns and serving ads for products targeting vulnerable mental states.
  • •Political data firms classifying voters by persuadability and deploying different emotional appeals to each segment.
  • •E-commerce sites adjusting pricing and urgency signals based on individual behavioral profiles.

Historical case studies

FTC v. Cambridge Analytica

2019Regulatory Action

The Federal Trade Commission found that Cambridge Analytica deceived Facebook users through a personality-quiz app that told them it would not collect identifiable information, while harvesting profile data from the quiz takers and their friends, tens of millions of people in total, in order to train models scoring personality traits for voter targeting. The Commission's December 2019 opinion barred the company from such misrepresentations and required the data and any work product derived from it to be deleted. The case concerns how the profile was built, which is where the documented deception occurred.

Source →

Psychological targeting field experiments

2017Research

Sandra Matz and colleagues ran three Facebook advertising experiments reaching more than 3.5 million people, matching ad wording to the extraversion or openness implied by users' Likes. Matched ads produced up to about 40 percent more clicks and 50 percent more purchases than mismatched ones. The paper is the strongest published evidence that trait-matched messaging works at scale; the absolute effects were small (purchases by a fraction of one percent of viewers), the products were cosmetics and games rather than votes, and critics have noted that the platform's own ad-delivery optimization complicates the comparison.

Source →

Ethical guidelines

Where the line is

Understanding an audience in aggregate is normal. It becomes manipulation when profiles are built without meaningful consent, are aimed at psychological vulnerabilities, or are used to exploit individuals rather than to serve them.

  • ●Profiling people's psychological vulnerabilities for exploitation is a fundamental violation of human dignity.
  • ●The asymmetry of knowledge — they know your weaknesses, you don't know theirs — is inherently coercive.
  • ●This represents perhaps the most concerning intersection of technology and persuasion in human history.

How to defend against it

  • ►Minimize your data footprint: use privacy tools, limit social media usage, opt out of tracking.
  • ►Assume that any platform with your data is profiling you — because they almost certainly are.
  • ►Support regulation requiring transparency about psychological profiling and the right to opt out.

From the Defense Playbook

Every playbook entry states how strong its evidence is and when not to use it. Browse the full playbook.

DISARM framework

How analysts would file this in the open DISARM framework (v1.6.1, CC BY-SA 4.0). Closest matches, mapped by Persuasion Lab.

T0072.004Psychographic SegmentationT0113Employ Commercial Analytic FirmsT0080.001Monitor Social Media Analytics

References

  1. Kosinski, M., Stillwell, D., & Graepel, T. (2013). Private traits and attributes are predictable from digital records of human behavior. Proceedings of the National Academy of Sciences, 110(15), 5802–5805
    The entry's claim that online behaviour reveals personality and other private traits: Facebook likes alone predicted personality dimensions, sexual orientation, political views and other attributes with substantial accuracy.
  2. Matz, S. C., Kosinski, M., Nave, G., & Stillwell, D. J. (2017). Psychological targeting as an effective approach to digital mass persuasion. Proceedings of the National Academy of Sciences, 114(48), 12714–12719
    The step from profile to persuasion the entry describes — matching the style of appeal to the person's traits: ads congruent with users' inferred extraversion or openness drew more clicks and purchases than incongruent ads; effect sizes were small and the field design has been criticised, so the 'each person matched with their weakness' claim should be read as demonstrated in principle rather than as a precise science.
Last reviewed
Suggest a correction

Detect Data-Driven Persuasion Profiling in any text

Paste any message, email, or article into our free Manipulation Detector to see if Data-Driven Persuasion Profiling or other techniques are being used on you.

Related Articles