Chapter Eight. You Can't Fetch Coffee If You're Dead.
What Governance Actually Needs to Do
Safety isn't a feeling. It's a set of conditions that either exist or
don't, can be verified or can't, and hold under pressure or fail
exactly when they're needed.
In 2009, a philosopher at Oxford named Nick Bostrom published a thought
experiment that has become, depending on who you ask, either the most
important idea in artificial intelligence safety or the most distracting one.
Imagine, he said, a s