The Trustworthy Thinker Scorecard
Four questions that separate honest thinkers from ideologues and charlatans
- Difficulty
- Easy
- Time to result
- ~days to results
- Steps
- 4
- Confidence
- 82%
Williamson built this four-question test off-the-cuff when a fellow creator asked how he gauges whether other creators are trustworthy and not audience-captured. The mechanism runs four independent checks on a thinker: (1) mind-changing history, because someone who no amount of evidence could move holds an ideological belief, not a rational opinion; (2) outgroup bonding, because leaning on a shared enemy is the charlatan's fast track to affiliation and produces fragile purity spirals; (3) genuine versus performative mistake admission, since real vulnerability is a costly signal of valuing accuracy over seeming perfect; and (4) whether they engage opposing views to learn rather than to mock. A thinker who fails these becomes predictable, tribal, and increasingly a caricature — the tell-tale sign of audience capture.
Origin
Chris Williamson improvised this during a dinner with DJ Oliver Heldens, who asked how to gauge whether other creators are honest and not audience-captured. Williamson noticed he ran an implicit process and articulated it for the first time out loud.
Core principles
- 01A rational opinion can be changed by evidence; an ideological belief cannot
- 02Fusing your ego to your stances makes you less objective over time
- 03Bonding a group over hatred of an outgroup is inherently fragile
- 04Admitting real mistakes is a costly signal of caring about accuracy over image
- 05Engaging opposing views without mocking them proves you seek truth, not tribe
How to run it
- 1
When did they last change their mind?
Ask whether any evidence would alter their stance. If they cannot tell you what would change their view, they hold an ideological belief, not a rational opinion.
Pro tip The thinkers to respect least treat changing their mind as destruction of their sense of self.
- 2
Do they bond their in-group by naming enemies?
Check whether they primarily identify outgroups as a mode of bonding for their in-group. Manufacturing an enemy is the charlatan playbook and creates fragile, purity-spiralling coalitions.
Watch out Distinguish genuinely admiring someone from merely disliking the people they dislike — the two feel identical from the inside.
- 3
Do they admit mistakes genuinely, not performatively?
Openness is a costly signal that a person cares more about being accurate than seeming perfect. Look for real, embarrassing admissions.
Watch out Watch for 'performative mistake porn' — smart charlatans stage a harmless confession as a smokescreen against charges of hubris.
- 4
Do they engage opposing views to learn, not to mock?
If the only divergent voices they platform exist to be made to look silly or for clickbait, they are not concerned with the truth. Real engagement models disagreement without a slanging match.
Pro tip A final tell: can you accurately predict this person's opinion on any topic before hearing it? If so, they are likely audience-captured.
In the wild
Williamson cites his own interview with researcher David Ley, who holds pro-porn and pro-cuckoldry views Williamson does not share. Rather than staging it to mock, he ran a respectful conversation between two people who disagree. He judged the episode a success precisely because it modelled that you can host a differing viewpoint, learn something, and not turn it into an internet slanging match.
→ A widely well-received episode that demonstrated truth-seeking engagement over tribal point-scoring.
Common mistakes
Mistaking dislike-of-enemies for admiration
People often think they look up to a creator when really they just enjoy that the creator hates the same people they do. This bonding is fragile and sneaks in under the surface.
Falling for performative mistake porn
A staged, low-stakes admission of error can masquerade as vulnerability. Check whether the confessed mistake is actually embarrassing or costly to them.
Is it for you?
Best for
Anyone deciding which podcasters, writers, or public intellectuals deserve their trust and attention.
Not ideal for
Evaluating people on technical competence or deeds rather than intellectual honesty.
From the transcript
“If no amount of evidence would change someone's opinion, then they don't hold a rational opinion, they hold an ideological belief.”
“Can you accurately predict this person's opinion on any topic without having heard them talk about it?”
From the episode
16 Lessons From 600 Episodes - Andrew Schulz, Douglas Murray & Alex Hormozi - #600