Value Alignment

Human Compatible

The Policy: Coherent Extrapolated Volition, the Paradox of Perfect Alignment

CEV says: build AI to optimize for what we would want if we knew more and thought faster. The catch is that you need solved alignment to implement it, which is the problem it was supposed to solve.