AI doesn't want anything. Why would it misbehave?

The concern doesn't require emotions or consciousness. A chess engine doesn't “want” to win, yet its behaviour is organised around winning. Optimising systems can act in goal-directed ways — and pursue proxies we didn't intend — without any inner desire at all.

← All questions