October 1, 2025
Extrapolated Volition
Browse posts by tag
October 1, 2025
The Policy
A speculative fiction novel exploring AI alignment, existential risk, and the fundamental tension between optimization and ethics. When a research team develops SIGMA, an advanced AI system designed to optimize human welfare, they must confront an …
September 10, 2024
The Policy: When Optimization Becomes Existential Threat
Some technical questions become narrative questions. The Policy is one of those explorations.
The Setup
Eleanor Zhang leads a research team developing SIGMA—an advanced AI system designed to optimize human welfare through Q-learning and tree search …