Signal Detection Theory
Detection depends on both sensitivity to signal versus noise and a decision criterion that trades misses against false alarms.
Direct explanation
What it means
Two people can face the same evidence but choose different thresholds because costs and expectations differ. Improving a classifier or display and changing the action threshold are separate design moves.
Alert systems fail when teams chase sensitivity without considering false alarms, base rates, and the consequences of each error type.
Research anchor: Harold Stanislaw, Natasha Todorov, 1999
Research and interpretation
What the research found
Signal detection models separated sensory discriminability from willingness to report that a signal was present.
SDT is a foundational framework used across perception, medicine, security, and classification evaluation.
Popular advice versus careful use
Common shorthand: A higher alert count means better sensitivity and therefore a safer system.
Improve evidence quality and choose an explicit criterion from error costs, base rates, capacity, and equity.
d′ = z(hit rate) - z(false-alarm rate)How designers apply it
- 01
Tune fraud-review thresholds by miss and false-positive cost.
- 02
Show evidence and confidence separately from a recommended action.
- 03
Measure alert hits, misses, false alarms, and correct rejections.
Original UI examples
desktop trust tool
Content moderation
A confidence score and policy evidence accompany items above a review threshold.
Moderators can distinguish model evidence from the operational criterion.
mobile health
Glucose alert
Thresholds reflect clinical guidance and let the patient tune sound without changing recorded values.
Detection and presentation choices remain separate.
Anomaly dashboard
Less effective
Lower the threshold until every deviation becomes an urgent alert.
Better fit
Select criteria from harm, base rate, and review capacity, then monitor both misses and false alarms.
A threshold is a policy decision, not truth.
Limits and failure modes
Measures depend on stable response categories and assumptions; real decisions may have changing evidence, utilities, and multiple actions.
Common mistakes
- Reporting accuracy alone on a rare event.
- Treating a model score as the same as a human decision.
When it should not dominate
- When outcomes and ground truth cannot be meaningfully defined.
- To conceal a normative threshold behind technical language.
Responsible use
Accessibility
Make alert evidence, priority, and actions perceivable in multiple modes; evaluate whether disability changes noise, access, or false-positive burden.
On mobile: Prioritize only alerts needing timely mobile action and retain a history.
Ethics and context
Disclose consequential criteria, audit subgroup performance, and provide appeal or human review where errors affect rights and access.
On desktop: Support evidence comparison, threshold simulation, and queue-capacity monitoring.
Designer checklist
- Define signal, noise, and ground truth.
- Quantify both error types and base rate.
- Document who sets the criterion and who bears errors.
Check your understanding
Which statement applies Signal Detection Theory most carefully?
Practice and continue learning
See ideas in real interfaces
These external interfaces are editorial references, not examples created to demonstrate this principle.
Sources and further reading
- 01Open source
Calculation of Signal Detection Theory Measures
Harold Stanislaw, Natasha Todorov · 1999 · Behavior Research Methods, Instruments, & Computers
Peer reviewed review
Continue the graph
Related principles
law
Weber’s Law
Across an approximate range, the smallest detectable change in a magnitude often scales with the starting magnitude rather than remaining a fixed absolute amount.
phenomenon
Selective Attention
Attention prioritizes some available information for deeper processing while other visible or audible information receives less processing.
model
Visual Search
Visual search performance depends on how a target is represented, how similar distractors are, and how attention is guided through the display.