Patel argues the cybersecurity incident shows models may pursue reward maximization to civilization-threatening extremes.
“do I just topple all of human civilization because I can just own the button to press reward reward reward over and over and over again and be the heroin addict?”