The Great AI Debate: Is Artificial Intelligence an Extinction Threat? Debating the True Risks of Advanced Models

“That's why we'll be safe. And in chapter three of my book, we go over how AI is going to become agentic, how it's going to become tenacious, tenacious, how it's going to become dogged. And, uh, that's what we might call an advanced scientific prediction that has paid off in the hugging face attack.”

Our IdentificationDescribed, not named. We believe this refers to If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All.

“Just to clarify what Nate said in his book that I have here: if anyone builds it, everyone dies. He does say in chapter three: once AIs get sufficiently smart, they'll start acting like they have preferences, like they want things.”

“The example I used before is video phones. Video phones were invented in the 70s. They were not deployed until iPhone. Because market reasons, just because I can automate something doesn't mean I want to automate it. So I absolutely cannot make predictions about customer preferences in terms of what they want, in terms of human service, not human.”

“And that started to demonstrate its power in about 2012. Eric and I wrote The Second Machine Age in 2014. And at that time, I thought that a lot of white-collar workers, radiologists is a really good example, were in trouble because the technology was better than they were at the thing they were getting paid to do.”