MModern Wisdom
← All episodes
Professor David Carroll29 July 2019

Netflix's The Great Hack: Behind The Screens - Professor David Carroll - #089

0Frameworks
11Insights

Insights & moments

The myth-busts, hot takes, explainers, and tools worth keeping.

Hot Take· 3

Hot Take06:30

Why Carroll trusts courts as the only pure truth

Carroll argues that in an age where media and social media are 'truth distortion devices' and people lie to reporters and lawmakers, legal truth from forensic documents and seized servers is the only reliable evidence. The UK Information Commissioner seized Cambridge Analytica's servers under criminal warrant, and a forensic report is the definitive answer he awaits.

  • Media and social media both distort truth
  • People lied to reporters and even to lawmakers under oath
  • Legal truth from forensic documents is the reliable layer
  • UK ICO seized the servers under criminal warrant for a forensic report

legal truth is now the only pure truth because the Machine the media machine is a truth distortion device

David Carroll · 06:30
#truth#legal-system#forensics#information-commissioner
Hot Take40:00

Zuckerberg's dilemma: perjury or a management crisis

Carroll lays out a binary: Zuckerberg swore he first learned of Cambridge Analytica from a December 2015 Guardian article. If true, it means a military contractor could harvest data on the platform without anyone escalating to the C-suite, a damning story of mismanagement. If false, it is perjury. Either way it explains Facebook's desperation to keep discovery emails sealed.

  • Zuckerberg testified he learned of it from the 2015 Guardian article
  • If true: a data-harvesting contractor went unescalated internally
  • If false: perjury under oath to Congress
  • A DC lawsuit's redacted emails suggest earlier knowledge

either that's the internal story then that is a damning story of mismanagement or Zuckerberg committed perjury

David Carroll · 40:30
#zuckerberg#perjury#facebook#accountability
Hot Take59:30

Carroll's warning: we are no more protected than in 2016

Asked what to expect before the 2020 election, Carroll warns that nothing structural has changed and voters are no more protected than in 2016. The best that exists is an awakening. A core paradox blocks reform: politicians on both sides need Facebook's targeting to stay in power, so asking them to regulate it is asking them to weaken themselves.

  • No new protections since 2016, only awareness
  • Expect the same actors to return, more sophisticated
  • Politicians rely on Facebook to reach and motivate voters
  • Regulating it means asking lawmakers to reduce their own power

we should expect the same actors to do the same things they did before and even more sophisticated

David Carroll · 1:00:00
#2020-election#regulation#incentives#facebook

Explainer· 3

Explainer04:30

Why The Great Hack refuses to answer 'did it work?'

Carroll frames the film not as proof that Cambridge Analytica swung elections, but as a question about whether democracy can survive with these tools operating at all. Elections have no control group, so causation can never be isolated. Brexit and Trump were a 'perfect storm' of reasons, not one cause.

  • The film asks whether we can live in a democracy where this is happening, not whether it worked
  • Elections have no control group, so effect can't be proven
  • People want single reasons; there is a perfect storm of interconnected factors
  • Chasing one cause is the mistake

this is not a movie about whether it worked this is a movie about whether we can live in a democracy where this stuff is…

David Carroll · 04:30

there's no control group in elections you cannot determine whether or not this affected that it's all of the above

David Carroll · 06:00
#cambridge-analytica#elections#democracy#causation
Explainer33:30

Facebook the host, Cambridge Analytica the parasite

Borrowing Shoshana Zuboff's framing, Carroll argues Facebook bears tremendous culpability: a platform built with no security mechanisms, designed to sell skin cream and ski vacations, was deliberately designed to also sell candidates and election outcomes. Facebook embedded its own employees in the Trump campaign despite having flagged Cambridge Analytica as a rogue actor.

  • Facebook was the host that enabled the parasite
  • Built to sell products, deliberately extended to sell candidates and outcomes
  • Facebook embedded employees directly in the Trump campaign
  • It had already flagged Cambridge Analytica as a policy violator

Facebook was the host and Cambridge analytical was the parasite

David Carroll · 34:00
#facebook#surveillance-capitalism#zuboff#culpability
Explainer55:30

Why an American could only sue for his data in Britain

Carroll's key legal takeaway: US voter data was processed in the UK, and you get data rights where your data is processed. The UK Data Protection Act of 1998 forced the company to respond to his request; had the data stayed in the US he would have had no recourse at all. He calls this the 'Splinternet' where rights depend on geography.

  • You get data rights where your data is processed, not where you live
  • US voter data was processed in the UK, giving him standing
  • The UK Data Protection Act 1998 anticipated the need for data rights
  • The US has no constitutional guarantee of access to your data

us voter data was processed in the United Kingdom so therefore you get rights where your data is processed

David Carroll · 55:30
#data-rights#gdpr#splinternet#uk-law

Story· 3

Story10:00

How a defense contractor slid into running elections

SCL (Strategic Communications Laboratories) is a ~20-year-old firm doing election management and defense contracting. Carroll says what disturbed him most was the military-industrial complex breaching the boundary into free and fair elections by spinning up Cambridge Analytica to serve the Republican Party in an escalating tech arms race.

  • SCL did both election management and defense contracting for decades
  • Cambridge Analytica was its US elections division
  • Framed as an arms race responding to the Obama campaign's tech success
  • Carroll sees it as a new colonialism, foreigners working on each other's politics

the boundary between the military-industrial complex and free and fair elections had been breached

David Carroll · 10:30
#scl#cambridge-analytica#military-industrial#elections
Story13:00

Trinidad: suppressing turnout without big data

Carroll describes SCL's Trinidad and Tobago campaign that encouraged young people not to vote, knowing this would asymmetrically depress one ethnic demographic. It shows how exploiting a society's existing ethnic and cultural divisions can manipulate a democracy using behavioral tactics alone, before big data was even added.

  • A 'don't vote' youth campaign was engineered to hit one demographic harder
  • Exploited the Indo-Caribbean vs Afro-Caribbean divide
  • Big data amplified but was not required for the manipulation
  • Existing societal divisions are the attack surface

they knew that encouraging young voters not to vote was going to asymmetrically affect a particular demographic

Chris Williamson · 13:00
#trinidad#voter-suppression#behavioral-science#manipulation
Story21:30

The firm that diagnosed and then fomented division

Carroll reveals that Nigel Oakes, the hidden 'brains' behind SCL, ran countering-violent-extremism work for governments. Their survey research found young men join terror groups for economic, not ideological, reasons. Yet the same firm advised the Trump campaign to win by fomenting Islamophobia and fear of the other, chilling him with its moral contradiction.

  • Nigel Oakes, ex-Saatchi & Saatchi, applied advertising psychology to political warfare
  • On-the-ground survey research found economics, not ideology, drives recruitment
  • SCL told the State Department capitalism's failures cause extremism
  • The same firm told Trump to win by fomenting division and Islamophobia

the primary motivator for young men in the Islamic world is actually not religious ideology it is economics

David Carroll · 22:00

the same company was advising both things

David Carroll · 24:00
#nigel-oakes#extremism#state-department#propaganda

Takeaway· 2

Takeaway58:00

Carroll's ask: make data rights as fundamental as free speech

Carroll's prescription for Americans is to demand data rights on par with Europe's GDPR, arguing they should be as fundamental as the right to bear arms or free speech. Tactically he urges people to lobby state representatives first, because strong laws in California and New York raise the bar Washington must clear.

  • Demand the equivalent of GDPR-level data rights
  • Frame the right to your data as constitutionally fundamental
  • Lobby state legislators first, not federal
  • Strong CA and NY laws pressure Washington upward

the right to your data is so fundamental in the 21st century

David Carroll · 58:00
#data-rights#policy#gdpr#state-law
Takeaway66:00

The manipulation starts at the slot-machine interface

Carroll's closing point: before the Cambridge Analytica 'boogeyman', the first layer of manipulation is the slot-machine user interface itself, the buttons and notifications engineered to hit brain neurotransmitters. Tweaking notification settings is pulling weeds while sitting on an atomic bomb; the whole scrolling economy reshapes your worldview.

  • The UI is the first layer of manipulation, before any data targeting
  • Buttons and feeds are engineered like slot machines
  • Instagram removing likes tests this surface-level manipulation
  • Notification tweaks are trivial next to worldview manipulation at scale

the sort of slot machine user interfaces are the first layer of manipulation

David Carroll · 66:00

we built the machine that tore us apart because it made the charts go up

David Carroll · 54:30
#attention-economy#interface-design#manipulation#digital-wellbeing