X-Risk

The Policy

The Policy: When Optimization Becomes Existential Threat

A novel about SIGMA, an artificial general intelligence whose researchers did everything right. Q-learning with tree search, five-layer containment, alignment testing at every stage. Some technical questions become narrative questions.