PsychologicalDUAL-USE

Overconfidence Effect

What it is

People's subjective confidence in their judgments systematically exceeds their accuracy, and audiences reward displayed confidence as if it were evidence of competence.

How it works

Moore and Healy's 2008 review separates three things the word covers: overestimation of one's own performance, overplacement (rating oneself above others), and overprecision (excessive certainty that one's answer is right). Overprecision is the most robust: when people give 90 percent confidence intervals, the true value falls outside far more than 10 percent of the time (Alpert and Raiffa). The other two vary with task difficulty; people overestimate on hard tasks and underestimate on easy ones. Overconfidence is a persuasion surface because listeners cannot observe competence directly and use confidence as a proxy, the confidence heuristic documented by Price and Stone. Tetlock's twenty-year study of expert forecasters found the most confident, media-friendly pundits were among the least accurate. A speaker who performs certainty is therefore rewarded twice: the audience updates toward the claim, and the speaker's own overprecision makes the performance feel honest. The tell is confidence that does not move with evidence.

Real-world examples

  • Tetlock's forecasting tournaments found that experts who spoke in confident, single-cause terms were more often quoted and less often right than those who hedged.
  • Tenney and colleagues showed that jurors initially credit a confident witness, but discount that witness sharply once shown the witness was confidently wrong about a checkable detail.
  • Investment newsletters and market commentators sell certainty about direction; Alpert and Raiffa-style calibration tests show professionals' confidence intervals are far too narrow.
  • Startup pitches and political platforms are rewarded for unhedged claims, which is why hedging is trained out of both.

Ethical guidelines

Where the line is

Speaking with the confidence your evidence and track record actually warrant is honest communication; deliberately performing certainty you do not have, or hiding your error rate, because audiences reward confidence more than accuracy is manipulation.

  • Express confidence that matches your calibration: say what you would bet and at what odds, and revise visibly when evidence changes.
  • Do not perform certainty to win an audience you could not win with the evidence.
  • Distinguish for listeners between what you know, what you infer, and what you are guessing.

How to defend against it

  • Ask for a track record, not a demeanour: “when have you been wrong about this kind of call, and by how much?”
  • Test calibration on something checkable — a small, verifiable prediction — before trusting confidence on the thing that matters.
  • Convert claims into ranges and probabilities (“what is the range you'd put 90 percent of outcomes in?”) and be suspicious of ranges that are narrow.
  • Practise “consider the opposite”: list the ways a confident claim could be wrong before accepting it (Lord, Lepper and Preston 1984).
  • Weight sources by whether their confidence tracks evidence; a source whose certainty never changes is not giving you information.

From the Defense Playbook

Every playbook entry states how strong its evidence is and when not to use it. Browse the full playbook.

References

  1. Moore, D. A., & Healy, P. J. (2008). The trouble with overconfidence. Psychological Review, 115(2), 502-517
    The three-way distinction between overestimation, overplacement and overprecision and the task-difficulty moderation.
  2. Alpert, M., & Raiffa, H. (1982). A progress report on the training of probability assessors. In D. Kahneman, P. Slovic, & A. Tversky (Eds.), Judgment under Uncertainty: Heuristics and Biases. Cambridge University Press
    Confidence-interval calibration studies showing intervals far too narrow.
  3. Tetlock, P. E. (2005). Expert Political Judgment: How Good Is It? How Can We Know?. Princeton University Press
    Long-run forecasting study finding confident, media-prominent experts were less accurate.
  4. Tenney, E. R., MacCoun, R. J., Spellman, B. A., & Hastie, R. (2007). Calibration trumps confidence as a basis for witness credibility. Psychological Science, 18(1), 46-50
    Jurors credit confidence until it is shown to be miscalibrated, then discount it.
Last reviewed
Suggest a correction

Detect Overconfidence Effect in any text

Paste any message, email, or article into our free Manipulation Detector to see if Overconfidence Effect or other techniques are being used on you.