saved
Armageddon by Anthropomorphism: On Security and the Frontier
gist
Steven Sinofsky argues that treating frontier AI as a Terminator-style killer is anthropomorphism. The essay's stated thesis is that AI changes the speed and scale of computer security, not the fundamental nature of the problem. He opens with Kyle Reese's speech about a machine that cannot be bargained with, naming that unstoppable-adversary story as the frame to drop. Keep AI inside ordinary computer-security work rather than a new species of apocalypse.
ideas
- Speed and scale, not a new problem. AI changes how fast and how widely computer security plays out; it does not change what the problem is.
- Anthropomorphism supplies the armageddon. The title names the mistake: treating software as an unstoppable person-like enemy.
- Drop the killer-machine frame. The Reese quote is the picture of a machine that cannot be bargained with; the subtitle is the correction.
- Stay in the existing security arc. If the nature is unchanged, the useful response is computer-security practice at new speed, not a special AI-apocalypse category.
quotes
“AI changes the speed and scale of computer security, not the fundamental nature of the problem.”
“It can’t be bargained with. It can’t be reasoned with. It doesn’t feel pity, or remorse, or fear.”