PsychologicalDUAL-USE

Illusion of Explanatory Depth

What it is

People believe they understand how things work — zippers, toilets, tariffs, sanctions — far better than they do, and the illusion collapses only when they are asked to produce the actual mechanism step by step.

How it works

Rozenblit and Keil showed in 2002 that people rate their understanding of everyday devices highly, drop those ratings sharply after attempting a written causal explanation, and are surprised by the drop. The illusion arises because familiarity with an object, fluency with its vocabulary, and the availability of other people's knowledge all feel like understanding from the inside; we live in a community of knowledge and mistake access for possession. Fernbach, Rogers, Fox and Sloman extended this to politics in 2013: asking people to explain the mechanism of a policy (not to justify their position) lowered both their rated understanding and the extremity of their views, whereas listing reasons did not. Crawford and Ruscio's 2021 preregistered replications reproduced the drop in rated understanding but not the reduction in extremity, so the depolarising use should be treated as promising rather than established. The persuasion surface is clear either way: a speaker who is fluent, confident and uses the right terms is credited with understanding that neither speaker nor listener can actually cash out.

Real-world examples

  • •In the original studies, participants confident about how a flush toilet or a helicopter works could not produce a coherent mechanism when asked, and revised their self-ratings downward.
  • •Voters across the spectrum express strong views on cap-and-trade, single-payer health care, or tariff policy while being unable to describe how the policy would produce its claimed effects; the 2013 study used exactly such issues.
  • •Financial products such as structured notes and crypto yield schemes are sold to buyers who feel they understand “how it makes money” because the vocabulary is familiar.
  • •Pundits and salespeople deploy fluent jargon precisely because listeners credit fluency as depth.

Ethical guidelines

Where the line is

Helping someone discover the limits of their understanding so they can decide more carefully is education; relying on their false sense of understanding to sell a policy, product, or investment they could not evaluate if they saw the mechanism is exploitation.

  • ●Invite the audience to trace the mechanism themselves rather than trading on their sense that they already understand.
  • ●Do not manufacture a feeling of understanding with jargon and confident delivery in place of an explanation that could be checked.
  • ●When using the explanation task to reduce polarisation, apply it to your own positions as well as to others'.

How to defend against it

  • ►Before committing to a policy position, a purchase, or an investment, write out how it works from start to finish in your own words; where the explanation runs out is where you are trusting someone else.
  • ►Ask the persuader for the mechanism, not the conclusion: “walk me through how this produces that result,” and notice whether the answer is causal steps or restated confidence.
  • ►Treat your own fluency with a topic's vocabulary as a warning sign rather than a credential.
  • ►In arguments, ask the other person to explain the mechanism of their preferred policy rather than to justify it; this is more likely to soften both of you than trading reasons is.

From the Defense Playbook

Explain the Mechanismminutes

Before taking or accepting a strong position, try to explain step by step how the policy, product, or claim actually works, because the attempt reliably reveals that you understood less than you felt you did and deflates the confidence a persuader was counting on.

Every playbook entry states how strong its evidence is and when not to use it. Browse the full playbook.

References

  1. Rozenblit, L., & Keil, F. (2002). The misunderstood limits of folk science: An illusion of explanatory depth. Cognitive Science, 26(5), 521-562
    Original demonstration that rated understanding of devices collapses after an explanation attempt.
  2. Fernbach, P. M., Rogers, T., Fox, C. R., & Sloman, S. A. (2013). Political extremism is supported by an illusion of understanding. Psychological Science, 24(6), 939-946
    Asking for mechanistic explanations of policies reduced rated understanding and position extremity; listing reasons did not.
  3. Crawford, J. T., & Ruscio, J. (2021). Asking people to explain complex policies does not increase political moderation: Three preregistered failures to closely replicate Fernbach, Rogers, Fox, and Sloman's (2013) findings. Psychological Science, 32(4), 611-621
    The drop in rated understanding replicated, but the reduction in extremity did not; the depolarisation use is not yet established.
Last reviewed
Suggest a correction

Detect Illusion of Explanatory Depth in any text

Paste any message, email, or article into our free Manipulation Detector to see if Illusion of Explanatory Depth or other techniques are being used on you.

Try the Detector FreeCreate Free Account