Roko's Basilisk

Roko’s Basilisk is a thought experiment from a 2010 LessWrong discussion that became an internet meme and a subject of implicit-religion analysis. Its familiar retelling imagines a future superintelligence punishing people who knew it might exist but did not help create it. The historical subject is the argument and its reception, not an established threat.^[1][4]

The original discussion

The preserved mirror dates Roko’s post, “Solutions to the Altruist’s burden: the Quantum Billionaire Trick,” to 23 July 2010. It addresses incentives for people who believe work on existential risk deserves more support than they provide. The future-punishment proposal sits within a broader discussion of decision theory, donations and speculative ways of directing resources.^[1] The title and context are wider than the compact horror story later associated with the basilisk.

The incentive claim

The proposal depends on a future system being able and willing to make an earlier person’s decision depend on anticipated later treatment. Knowing about the proposed incentive is therefore part of its imagined operation. These assumptions do the work; a powerful AI’s possible existence alone does not establish the incentive or make punishment rational. The preserved discussion and later community account record objections rather than a settled result.^[1][2]

Deletion and later explanation

Eliezer Yudkowsky removed the post and restricted discussion of the topic. The LessWrong wiki reproduces his 2014 explanation that he regarded the original argument as wrong while worrying more generally about possible information hazards. The response therefore should not be read as straightforward endorsement of the basilisk’s reasoning.^[2] The restriction and reported distress also became subjects of later commentary.

From forum dispute to public meme

David Auerbach’s July 2014 Slate article presented the episode to a wider audience through an alarming thought-experiment frame. BBC Future’s 2019 account placed it in a discussion of possible religious futures.^[3][5] These retellings are evidence of reception, rather than additional witnesses to the original posting or proof of the argument.

Why religious comparison arises

Beth Singler compares the basilisk and singularity thought experiments with Pascal’s wager through the concept of implicit religion. Her public account of this research emphasizes how apparently secular communities draw boundaries between religious and rational arguments.^[4][6] This makes the basilisk relevant to religious analysis without identifying it as a church or a shared devotional practice.

The surviving record

The origin account depends on a preserved mirror and later forum documentation. The original proposal, its moderation and its subsequent cultural interpretation should remain distinguishable. Nothing in this source set establishes the hypothetical entity’s existence or converts the thought experiment into a reliable prediction.

See also

• Hyperstition
• Provenance
• Apocalyptic AI
• Machine hierology

References

1. Roko, “Solutions to the Altruist's burden: the Quantum Billionaire Trick.” Preserved mirror of the original post, 23 July 2010.
2. LessWrong community wiki, “Roko’s Basilisk,” sections “Roko’s post” and “Topic moderation and response”. Updated 30 November 2022; reproduces and links Eliezer Yudkowsky’s 2014 Reddit comments.
3. David Auerbach, “The Most Terrifying Thought Experiment of All Time.” Slate, 17 July 2014.
4. Beth Singler, “Roko's Basilisk or Pascal's? Thinking of Singularity Thought Experiments as Implicit Religion.” Implicit Religion, 20(3), 279–297, 2018. doi:10.1558/imre.35900.
5. Sumit Paul-Choudhury, “Tomorrow's Gods: What is the future of religion?” BBC Future, 2 August 2019.
6. Beth Singler, “Don’t Read This Post.” 23 March 2016. Author-published conference abstract for the research later developed in the cited article; the two sources share a research lineage.