Sacks argues branding as the safe AI company can lead to regulatory capture and monopolistic control.
“Now, I think the issue is just you can see how this can lead to red capture, right?”
Sacks says Dario Amodei refused White House request to take down Fable after jailbreak report.
“And the TLDR of it is Dario refused, meaning refused their request to take down Fable until this jailbreak could be fixed.”
Sacks says Anthropic blindsided partner Figma by launching competing product while its CPO was on Figma's board.
“Anthropic's chief product officer had actually even served on Figma's board and didn't resign until three days before the launch of Clawd Design. So obviously, Figma again felt blindsided by this.”
Sacks argues bio risks can be addressed by regulating DNA synthesis at physical chokepoints rather than creating new regulatory agencies
“@JTLonsdale Bio is an area of concern, but that doesn’t require a new rule-making agency with expansive powers. We can regulate DNA synthesis at the physical chokepoint, as this letter proposes. Targeted solutions for specific risks is better than new bureaucracies. https://t.co/mD5LEovKZK”
Sacks frames his disagreement with Dario Amodei as centralization versus distribution of frontier AI power.
“Dario believes frontier AI is too powerful to distribute; we believe it is too powerful to centralize.”
Sacks explains that open models cannot be monitored or rolled back after release due to local deployment.
“Once you release an open model into the world, you can't roll it back and you can't monitor exactly how people are using it because they run it on their own hardware.”
Sacks says Hugging Face was forced to use Chinese AI models for cyber defense because American model guardrails blocked them.
“They're being forced to turn to Chinese models for cyber defense because the guardrails have prevented them from having the latest and greatest American models.”