The Definition Integrity Test
Demand boundaries, essential features, and non-circular language
- Difficulty
- Easy
- Time to result
- ~days to results
- Steps
- 6
- Confidence
- 97%
Benjamin evaluates definitions by asking whether they have limits, essential characteristics, exclusions, and a non-circular structure. A definition should tell the listener what a thing is and distinguish it from what it is not. If the term appears inside its own definition, the explanation loops without adding information. If essential qualifiers disappear, unintended cases enter the category and the rule becomes unstable. After stating the definition, list included and excluded cases, probe its boundaries, and identify what observation would show the classification is wrong. The result is a shared, falsifiable concept that can support substantive discussion instead of forcing every disagreement into an unresolved semantic contest.
Origin
Benjamin articulated the test while contrasting common-language definitions with self-referential definitions in contemporary political disputes.
Core principles
- 01A definition must supply information about the thing
- 02Essential characteristics create usable limits
- 03Exclusions matter as much as inclusions
- 04A term cannot define itself
- 05A useful claim must be open to falsification
How to run it
- 1
State the category
Write a single-sentence definition using ordinary terms that themselves already have stable meanings.
Pro tip Prefer the shortest version that preserves the necessary distinctions.
- 2
Extract essential features
Mark each characteristic without which the thing would belong to a different category.
Watch out A long list of incidental traits can hide the absence of essential ones.
- 3
Check for circularity
Replace any use of the term inside its own definition with an independently meaningful description.
Pro tip Follow every referenced term until the explanatory chain reaches stable language.
- 4
Map exclusions
List nearby cases that should not qualify and verify that the wording actually keeps them out.
Pro tip Boundary cases reveal more than obvious examples.
- 5
Run edge cases
Apply the definition to unusual examples and inspect whether it creates absurd or unintended classifications.
Watch out Do not rewrite the rule after each case without documenting the changed principle.
- 6
Set the falsifier
Specify what evidence would demonstrate that a classification or claim using the definition is wrong.
Watch out An unfalsifiable definition cannot settle a factual dispute.
In the wild
The episode critiques defining a woman as anyone who identifies as a woman. Because the term being defined reappears as the explanation, the sentence loops without supplying independent content.
→ The circularity check rejects the definition before the argument moves to policy consequences.
Benjamin asks what happens when adult or human is removed from a category definition. The exclusions test then surfaces children or non-humans as unintended cases admitted by the looser wording.
→ Edge cases show why each essential qualifier affects the rule's usable boundary.
Common mistakes
Defining a word with itself
Self-reference creates an infinite loop and provides no new information about category membership.
Checking only included cases
A definition can fit intended examples while accidentally admitting cases the rule was meant to exclude.
Winning through semantic drift
Quietly changing a term during debate prevents the participants from testing the same claim.
Is it for you?
Best for
Writers, researchers, and teams defining contested terms before making arguments, policies, classifications, or product rules.
Not ideal for
Open-ended artistic metaphors whose purpose is evocation rather than consistent classification.
From the transcript
“It's got particular limits, it has essential characteristics, and it's not self-referential.”
“you've got this recurring loop in the definition of the word. And so, the sentence is never actually completed.”
“the important thing about definitions is also what's excluded from the definition, not just what's included.”
From the episode
Making Sense Of 2021's Madness - Carl Benjamin - #280
Carl Benjamin