All corrections
Substack September 27, 2026 at 05:12 PM

quillette.substack.com/p/an-open-letter-to-scott-alexander

1 correction found

1
Claim
A 2025 Rand Corporation modelling analysis steel-manned the AI-extinction hypothesis by granting the assumption that AI had the objective to wipe out humanity, and concluded that there is “no describable scenario in which AI is conclusively an extinction threat to humanity.”
Correction

This misstates the RAND report. The quoted line was the report’s starting hypothesis, not its conclusion; RAND’s findings said AI-driven extinction was immensely challenging but "could not rule out the possibility."

Full reasoning

The article presents “no describable scenario in which AI is conclusively an extinction threat to humanity” as the RAND report’s conclusion. But the report itself used that sentence as a falsifiable hypothesis in its approach section.

Evidence:

  • RAND’s own report summary says the researchers “found that it would be immensely challenging for AI to create an extinction threat, although they could not rule out the possibility.” It also says that in the three scenarios studied, extinction “would not be a plausible outcome unless an actor was intentionally seeking that outcome.” That is much weaker than saying RAND concluded there was no describable scenario.
  • A Scientific American article by Michael J. D. Vermeer, the RAND report’s lead author, explicitly explains the sentence’s role: “My team’s hypothesis was this: No scenario can be described in which AI is conclusively an extinction threat to humanity.” In other words, it was the team’s starting hypothesis, not the finding they ended on.
  • A text mirror of the report shows the structure directly: under Approach, the report says “Our analysis proceeds from a falsifiable hypothesis: There is no describable scenario in which AI is conclusively an extinction threat to humanity.” Later, under Findings, it says “We found that all three scenarios posed global catastrophic threats...”

So the problem is not merely wording. The essay turns a methodological premise into a reported conclusion, which materially changes what the RAND study actually said.

3 sources
  • On the Extinction Risk from Artificial Intelligence | RAND

    Using a scenario-based analysis to evaluate three technologies — nuclear weapons, pathogens, and geoengineering — they found that it would be immensely challenging for AI to create an extinction threat, although they could not rule out the possibility. ... In the three scenarios examined in this study — nuclear weapons, pathogens, and geoengineering — human extinction would not be a plausible outcome unless an actor was intentionally seeking that outcome.

  • Could AI Really Kill Off Humans? | Scientific American

    My team’s hypothesis was this: No scenario can be described in which AI is conclusively an extinction threat to humanity. ... If we could prove this hypothesis wrong, it would mean that AI might pose a real extinction risk.

  • On the Extinction Risk from Artificial Intelligence (text mirror)

    Approach: Our analysis proceeds from a falsifiable hypothesis: There is no describable scenario in which AI is conclusively an extinction threat to humanity. ... Findings: We found that all three scenarios posed global catastrophic threats, but human extinction would not be a plausible outcome unless an actor was intentionally seeking that outcome.

Model: OPENAI_GPT_5 Prompt: v1.16.0