✶Explainer01:30
X-Risk vs Global Catastrophic Risk: The Key Distinction
Mara Cortona draws the foundational distinction between existential risk (a risk to the entire species) and global catastrophic risk (mass die-offs and a drastically reduced quality of life without full extinction). She argues the latter is both more likely and more likely to happen sooner than the extinction-level events people usually picture.
- X-risk = threat to the entire species' existence or potential
- Global catastrophic risk = mass die-offs and low quality of life, not extinction
- Global catastrophic risks are more probable and nearer-term than classic x-risks
- Main anthropogenic x-risks: climate change, engineered pandemics/bioweapons, nuclear war
- Natural background risks (asteroids, supervolcanoes, natural pandemics) are low probability given ~2000 centuries of human existence without one
“Existential risk which is a risk to the entire species as we know it, and global catastrophic risks which perhaps wouldn't cause the entire extinction…”
#existential-risk#definitions#global-catastrophic-risk
✶Explainer09:00
COVID Proved Communication Is the Real Number-One X-Risk
Cortona reflects on how 2020 reshaped her thinking: the pandemic was well-modeled and expected, yet global response collapsed into politicization, hoax conspiracies, and inconsistent measures. She concludes that broken communication and collaboration systems underlie humanity's poor response to every other risk category.
- Pandemics at this scale were known and modeled well before COVID-19 hit
- The world was globally unprepared despite the foreknowledge
- Conspiracy theories and politicization undermined simple, well-understood mitigation measures
- Cortona now ranks communication/collaboration failure as the number-one underlying x-risk
- An engineered pandemic with higher mortality in the next century would have been catastrophic given this same response pattern
“I would say that the number one x-risk is really actually like communication — it kind of underlies our responses to all of the others.”
“It's very clear that our communication and collaboration systems are very broken and things are heavily politicized.”
#covid-19#communication#pandemics#collaboration
✶Explainer11:00
Why Your Brain Can't Grasp Trillions of Future Lives
Cortona explains that human psychology evolved around the Dunbar number (~150 people) — the tribal-scale sphere of relationships and influence we're wired for. Modern 'force multipliers' mean our actions (a $5 malaria-net donation) can affect people worldwide, but our brains still relate to impact on a one-to-one, storytelling level, making it extremely hard to value the trillions of potential future lives at stake in x-risk decisions.
- The Dunbar number (~150) is the historical tribal ceiling on relationships humans evolved to track
- We never evolved a concept of 'force multipliers' — one action can now affect people globally
- A $5 bed-net donation can be one of the most effective poverty/suffering interventions per dollar
- We're moved by single relatable stories (e.g. one girl) even when resources could do more good spread differently
- Valuing children is intuitive; valuing grandchildren, great-grandchildren, or trillions of unborn lives is not
“We never had any concept of force multipliers like we have now... I'm still operating in terms of like expecting to see people, my community,…”
#psychology#dunbar-number#altruism#future-generations
✶Explainer39:30
Why Climate Change Got Politicized But Asteroid Defense Didn't
Cortona lays out a spectrum of risk-response effectiveness: asteroid defense succeeded because it emerged unpoliticized (helped by 90s pop culture and the Shoemaker-Levy comet impact on Jupiter) and one country largely solved it for everyone. AI and nanotech risk sit neglected at the other extreme because they haven't caught public attention. Climate change sits in a 'perfect storm' middle zone — heavily politicized, turned into a tribal weapon by people without real expertise on either side.
- Asteroid risk response succeeded partly because it wasn't politicized and had strong pop-culture/scientific tailwinds (90s movies, Shoemaker-Levy comet hitting Jupiter)
- AGI and nanotechnology risks remain neglected — low funding, low public salience
- Climate change sits in the middle: massively visible but heavily politicized, becoming a tribal signaling tool
- Many people commenting on climate lack real grounding in the underlying statistics, unlike the smaller AGI-control-problem discourse
- Cortona is personally more concerned about the next pandemic than climate change
“It hit at the right time... it wasn't politicized and everybody was able to get behind it.”
“I'm much more concerned about the next pandemic personally than I am about climate change, and seeing our response to COVID-19 I'm even more so.”
#climate-change#politicization#risk-communication#ai-risk
✶Explainer47:30
The Prisoner's Dilemma and Why 'Tit for Tat' Beats Every Other Strategy
Cortona connects global cooperation failures to the prisoner's dilemma, referencing the famous 'tit for tat' strategy (from Anatol Rapoport) that starts from assuming good intentions and then mirrors whatever response it receives. She argues this is the most successful known algorithm for cooperative outcomes, but notes that real-world conditions (people fighting to survive) make pure cooperation hard to sustain past a certain threshold of anti-social behavior.
- The tit-for-tat strategy (credited to Rapoport) starts with assuming the best intentions, then mirrors the other party's last move
- It's described as the simplest and most successful known approach to the prisoner's dilemma
- Real-world complexity limits how cleanly this applies at civilization scale
- There's a tolerance threshold for anti-social behavior in a society before systemic collapse follows
- Cortona ties this to needing both personal responsibility and accountability for concentrated power
“The one algorithm that's so simple that is the most successful at returning the prisoner's dilemma is to start from a place of assuming the…”
#game-theory#cooperation#prisoners-dilemma
✶Explainer50:00
Toby Ord's Stark Odds: 1-in-3 This Century, 1-in-2 Ever
Referencing Toby Ord's 'The Precipice,' the hosts discuss his numerical estimate that humanity has a 1-in-3 chance of going extinct or permanently curtailing its potential within the next century, and a 1-in-2 chance across all of future time. Cortona says she wouldn't significantly revise these figures, though she flags that modeling struggles to account for humanity's adaptive capacity as well as unknown unknowns.
- Toby Ord estimates a 1-in-3 chance of extinction or permanent civilizational curtailment within the next century
- Ord estimates a 1-in-2 chance of the same happening ever (all future time)
- Most existential risk is 'front-loaded' into the coming century
- Cortona broadly agrees with Ord's numbers but flags that models can't fully capture human adaptive capacity (e.g. new ways of sourcing food/energy) or unknown unknowns
- Modeling is inherently uncertain, which itself is more a stressor than a comfort for her
“The chance that we go extinct or that we permanently mute our ability to reach our full potential as a civilization within the next century…”
“It does seem to be heavily front-loaded — it does seem to be an absolutely critical juncture.”
#toby-ord#the-precipice#probability#existential-risk