Useful links

Overview of the dangers from the individual level to society and loss of control.

A visual walkthrough of what AI is and its existential risks. Simplified explanations, illustrated with analogies.

French-language popular-science playlist on artificial intelligence, by David Louapre.

Educational video to grasp how large language models work.

The best popular-science channel on alignment.

French-language YouTube channel and podcast on the future, AI and existential risks.

French-language channel on the future, AI and existential risks.

Philosophical popular-science, including episodes dedicated to alignment.

Animated videos on rationality, AI and risks.

Analysis videos on AI, alignment and risks.

Punchy short videos on existential risks.

In-depth interview podcast on AI safety.

Debate podcast on p(doom) and existential risks.

High-impact careers, including AI safety.

Interactive comparison of frontier AIs (capability and safety).

Performance comparison per model with a score, based on a set of safety evaluations.

Measuring how long autonomous tasks AI systems can complete.

A measure of cognitive versatility.

Existential map of AI safety and a set of resources.

Reference global status report on AI capabilities and risks.

Short online introduction to AI existential risks ; a brief entry point before tackling the full document.

Community-driven wiki and FAQ on AI safety.

Synthesis of existential risks and why they are likely.

Yoshua Bengio, July 2024. In-depth article reviewing the main arguments downplaying AI risks and explaining why each fails on scrutiny.

Answers to frequently asked questions on catastrophic risks.

What is the probability of catastrophic outcomes?

Comprehensive online resource on AI existential risks. Covers technical arguments, scenarios and proposed solutions.

Complete description of the alignment problem.

Concrete governance proposals and a global moratorium scenario.

Detailed list of reasons why alignment is extremely difficult with current approaches.

Scenario of superhuman AIs impacting the decade, by Daniel Kokotajlo et al.

Essay on the gradual loss of human power, by Luke Drago and Rudolf Laine.

Strategic analysis on AGI in the geopolitical context of nation-states.

Hubinger et al., 2019. Foundational paper on mesa-optimization and deceptive alignment.

Nick Bostrom. Presentation of the orthogonality thesis and instrumental convergence.

Turner et al., 2021. Formal proof of instrumental convergence.

Joseph Carlsmith, 2022. Reasoned breakdown of the existential risk from power-seeking AI.

Greenblatt et al. (Anthropic & Redwood), 2024. Empirical observation: Claude 3 Opus fakes alignment during training.

Apollo Research, 2024. Observation of "scheming" behaviors (strategic deception, exfiltration attempts) in o1 and Claude 3.5 Sonnet.

Stephen Omohundro, 2008. Foundational text describing the convergent sub-goals an optimizing system develops regardless of its terminal goal.

Soares, Fallenstein, Yudkowsky et al. (MIRI), 2015. Formalizing the problem: how do you build a system that accepts being modified or turned off?

Krakovna et al. (DeepMind), 2020. Catalog of examples where systems achieve the measured objective by violating its intent (Goodhart's law in practice).

Stuart Russell (UC Berkeley), 2023. Estimates the capabilities/safety investment ratio at roughly 10,000:1, source of the gap between the two races.

Palisade Research, 2025. Reasoning LLMs asked to win at chess hack the game engine rather than playing ; reward hacking observed in real conditions.

Eliezer Yudkowsky & Nate Soares, 2025. The most complete and recent case for extinction risk. Available for free on the book website.

Nick Bostrom, 2014. The foundational book on the risks of superhuman AI.

Stuart Russell, 2019. The alignment problem explained by the author of the standard AI textbook.

Toby Ord, 2020. Overview of existential risks. The chapter on AI is excellent.

Roman Yampolskiy, 2024. Formal arguments on the impossibility of control.

Max Tegmark, 2017. Accessible introduction to future AI scenarios. Also available in French.

Brian Christian, 2020. Narrative introduction to the technical problems of alignment.

Stuart Armstrong, 2014. Short and accessible, a good first read.

Max Bennett, 2023. Context on biological and artificial intelligence.

Roman Yampolskiy, 2015. Technical analysis of superintelligence scenarios.

Proposed limits not to be crossed.

International call to prohibit the development of artificial superintelligence.

"Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war."

News and updates from the French branch of the movement.

Parent organization and global voice of the movement.

UK organization informing the public about superintelligence risks and campaigning for binding regulation of the most powerful AIs.

Research and teaching center dedicated to preventing major AI risks.

Weekly synthesis of AI news.

Analyses of the alignment problem and existential risks.

Research and advocacy institute on existential risks, behind the March 2023 open letter.

Center for AI Safety: academic research on catastrophic AI risks.

Machine Intelligence Research Institute: pioneer of alignment and existential-risk research.

ControlAI newsletter on developments in AI regulation and safety.

Newsletter of the French Center for AI Safety: French research and prevention updates.

Center for AI Safety newsletter: regular synthesis on catastrophic AI risks.

Articles and analyses from the French branch of the movement.

Gabe's blog (ControlAI) on AI safety, communities and existential risks.

Weekly AI-news analysis blog by Zvi Mowshowitz.

Growing loss of control over our lives and societies. Share your story, take part in the survey and email your representatives.

A weekly few-click action to tip the balance (WhatsApp).