The Negative Pilot Test
Deliberately stop a habit for weeks to see if it was ever pulling weight.
- Difficulty
- Easy
- Time to result
- ~weeks to results
- Steps
- 6
- Confidence
- 78%
The Negative Pilot Test flips the default instinct of end-of-year planning, which is to add more habits, tools and disciplines. Instead you deliberately remove one thing you're unsure is earning its place — a supplement, a tracking habit, a meeting, a morning ritual — for a defined window, long enough to see a real effect (weeks, not days). During the window you watch for two outcomes: either you notice a real drop in performance or wellbeing, which converts a vague assumption into conviction, or you notice nothing at all, which tells you the habit was never doing the work you credited it with. The method works because addition makes it impossible to isolate which of ten simultaneous changes caused a result, while subtraction isolates one variable directly. It also captures involuntary data — periods where illness or circumstance already forced the removal — as evidence rather than noise.
Origin
Extracted from Modern Wisdom — Johnny (of ProPrepFitness) framed it as testing whether a habit is 'actually helping or not by practicing not doing it for a while,' building on a period where COVID and a bad cold forced him off training and meditation and he noticed the impact was real, while stopping a gratitude journal changed nothing.
Core principles
- 01You can't tell what's driving a result by adding more things, only by removing them
- 02Involuntary removal (illness, forced breaks) is free data — pay attention to it
- 03Test one variable at a time or the result is uninterpretable
- 04A null result is still a result — it tells you the habit was theater
How to run it
- 1
List your uncertain habits
Write down routine elements — training extras, tracking systems, supplements, recurring meetings — that you keep doing on autopilot without real conviction they help.
Pro tip Look for anything you do 'because you think you have to' rather than because you've seen proof it works.
- 2
Pick exactly one to eliminate
Choose a single habit to remove. Testing more than one at a time destroys your ability to attribute any change to a specific cause.
Watch out Don't pick something with irreversible downside (e.g. stopping a medication) — this method is for optional routine, not anything medically load-bearing.
- 3
Set a real elimination window
Commit to a minimum of 2-4 weeks with zero exceptions. A few days is too short to separate a real effect from noise or novelty.
Pro tip Put the end date in your calendar so you don't quietly reintroduce the habit early.
- 4
Track outcomes, not just feelings
Note both objective markers (weight, output, revenue) and subjective ones (energy, mood, stress) across the window.
- 5
Compare to your baseline
At the end of the window, compare the results honestly against how things were running before you stopped.
Watch out Watch for confirmation bias — you may want the habit to have mattered because you spent years doing it.
- 6
Make the permanent call
Reinstate the habit with more conviction, drop it for good, or scale it down, based on what the test actually showed.
Pro tip A clean 'it didn't matter' result should be treated as a productivity win, not a failure.
In the wild
Johnny was sidelined from training twice in 2021 — once with COVID, once with a bad cold — and separately stopped meditating for a stretch. In both cases he expected minimal disruption but found the impact on mood and output was significant once the habit was actually removed.
→ He came away more convinced than before that training and meditation were load-bearing, not optional.
After hearing a podcast with Eric Helms arguing that eating by feel beats tracking, Johnny ran a one-month negative pilot on calorie tracking while dieting.
→ He gained weight during the month off tracking and went straight back to logging — a clear, unambiguous result.
Johnny also tested stopping a daily gratitude journal, a habit he'd kept 'because you think you have to.'
→ He noticed no meaningful change in mood or outlook, so the journal was dropped as low-value.
Common mistakes
Running a window too short to be meaningful
A few days off a habit mostly measures novelty and withdrawal, not the habit's real contribution — you need weeks to see the true effect.
Testing several habits at once
Stopping training, meditating and diet tracking in the same window makes it impossible to know which removal caused which change.
Treating a null result as a failure
Finding that a habit didn't matter is a valid, useful outcome — the point is to free up time and attention, not to prove every habit is essential.
Is it for you?
Best for
Anyone with a bloated morning routine, supplement stack, or business process who suspects some of it is dead weight.
Not ideal for
Habits with delayed or compounding effects (e.g. strength training, sleep) where a short window won't show the real cost of stopping.
From the transcript
“pick one thing to deliberately stop doing for a while”
“testing something whether something's actually helping or not by practicing not doing it for a while, barring yourself from doing something”
“I tried not tracking my calories while I was dieting for a period of time this year to see if I could get away with…”
From the episode
End Of Year Review: 2021's Lessons, Hacks & Fails - #416