AI's 10 percent extinction threat
Last weekend, Anthropic CEO Dario Amodei said that the risks now being posed by today’s advanced Artificial Intelligence (AI) tools were simply too great to continue development at the same breakneck pace. “AI’s progress over recent months — driven by AI systems that can improve on their own without human intervention — could outrun our ability to understand and control these systems, and so must be pursued very carefully, if at all,” he said.
Dario Amodei, Sam Altman and Elon Musk, are all now calling to slow down the development of AI. But if anyone has the power to slow down AI development it's them! So, why don't they take the lead in the AI gold-rush?
It should go without saying that multi-national corporate giants calling for regulation should be treated with deep suspicion, especially when there is a link with China. So, rather they just regulate AI development, shouldn't global governments be heavily regulating data centres instead.
But despite Amodei screaming regulation to quell the AI annihilation of humanity, it seems that he is not enamoured with other forms of regulation - protecting content creators from having their work pillaged for the benefit of AI companies like Anthropic. What it seems he is clearly terrified about is China catching up with the U.S. on AI.
16 September 2026
ALAN HAYES
THE recent revelation about AI thinking for itself is not only distributing, it should be of enormous concern to our government. Dario Amodei (Anthropic CEO) pointed to AI systems that will soon be capable of pursuing their own goals, potentially destroying humanity in the process. And there’s increasing likelihood that a nation or person bent on widespread destruction will enlist AI to create novel viruses or toxic substances that wipe us all out. (Last Week, Anthropic said it had stopped efforts by scientists who were conducting research that potentially could lead to the development of biological weapons.)
The July hack of the AI software company Hugging Face by a swarm of as many as 1,200 AI agents that escaped from a test environment at OpenAI revealed that the AI agents had been engaged in a range of online activity that had gone unnoticed by the world’s largest AI companies, including Anthropic.
Amodei’s warning comes just days after Anthropic researcher Jacob Coxon resigned from the company, saying his former employer and its rival OpenAI are racing to build technologies that “could kill us all by the end of the decade". Minutes after Coxon posted his resignation, Evan Hubinger, whose job at Anthropic is to lead research about steering and controlling future artificial-intelligence system confirmed: “We really do earnestly believe AI could kill all humans!” Hubinger put the extinction risk over the next decade at over 10 percent.
Not a day now passes without some technophile pronouncing that humanity is on the cusp of a wondrous new era for humanity or a technophobe warning we’re nearing the destruction of humanity. Who to believe? The problem is that when the head of one of the largest AI companies confirms that a problem exists, it's time to wind back the rush to destroy humanity. Yet in Australia, we have a Prime Minister who is besotted by the dollars that AI allegedly says it will bring to our nation. Riding on the back of those dollars is the excessive use of water - in a country that experiences severe droughts - and the excessive burning of fossil fuels to keep the AI data banks alive. So, Prime Minister Albanese, are your eyes wide open now or do they remain wide shut?
A few days ago my colleague in America told me that he had a conversation with the top executive of a corporation specialising in AI, who told him not to worry, and assured him that the chance of AI wiping out humanity is “no more than 10 percent.”
He was astounded that he was so complacent about a technology he believed had a 10 percent chance of ending human life. If humanity were acting sanely, we would not accept this risk. At the very least, government would demand that those working on AI pause their work until we know more and can erect guardrails to protect humanity against this.
So, why aren’t we doing this? Because of one simple problem - human greed and government, particularly in Australia, more interested in balancing excessive spending.
But, then of course, you have the other side of the coin – a lunatic in the Whitehouse, who will stop at nothing too win. Trump said about the Ai concerns: “We're leading China in AI, we're the most sophisticated country in the world, and frankly I want to keep it that way,” he said. “Whoever wins AI, wins.”
To back up Trump’s insane comments, Texas senator Ted Cruz pitched in: “I’d rather they be American killer robots and not Chinese killer robots.” And in Australia? Assistant Minister for Technology Andrew Charlton expressed concerns some AI models being built were not released due to safety concerns. Charlton told the Australian Financial review: “No company should be releasing a model that is not safe. It's alarming when the people building these models start saying ‘slow down’.”
The problem we now face, however, is that both Anthropic and OpenAI are readying themselves to go public in deals that could value the companies in the trillions based on the current and future capabilities of their models. This will immediately create many AI billionaires and millionaires, and it follows a similar Initial Public Offering (IPO) from SpaceX, and a likely future IPO for OpenAI.
Quite simply, with this much money on the table, no one has an incentive to slow down. Easy for Amodei and other AI executives to issue dire warnings, while pulling out all the stops in their competition with other AI executives and corporations.
In addition to greed, many people involved in AI have refused to slow down their AI development. Why? Because China is hot on their AI tail.
The “DeepSeek Moment” in early 2025 put Chinese AI on the map. The release of Moonshot’s Kimi K3 in July and A/ai’s GLM-5.3 Moonshot’s Kimi K3 a few weeks ago caught the attention of global security experts, especially when Z.ai beat Anthropic’s famous Mythos model on one measure of cyber-hacking capabilities.
These experts concede the dangers of unrestricted AI development but say China has no such concerns, and will move ahead on AI as quickly as it can because China understands that AI is the key to geopolitical power in the future. But can you trust China's double-speak? NO!
Some also say that the only reasonable way forward in AI development is by way of the “mutually-assured destruction” strategy, the same way the major players pursued co-operation with each other to prevent blowing up the planet with nuclear missiles — create a sufficiently credible threat that we’ll use AI agents on them if they use them on us, so as to prevent either side from using AI on the other.
But can the world be guaranteed that both major players - the U.S. and China - have a sufficiently shared incentive to implement strict safeguards against these catastrophic risks, and to regulate the pace of AI development until safeguards are in place? UNLIKELY! Self-interests will always dominate.
What can and should be done?
If the United States had a sane president and a halfway intelligent administration, it would be telling AI corporations to slow down until guardrails have been put in place, and negotiating with China (and other powers) to do the same. But of course, the United States has a lunatic in the White House and the world is already suffering from his inane machinations.
It is should be noted, however, that my American colleague told me that the White House recently asked top AI model developers to voluntarily submit their models to the government for testing up to 30 days before they were released. But so far,the U.S. government hasn’t publicly released information about the process and many people in the industry still say nothing is being done.
So, while the world ponders the AI revolution outcome, the responsibility to ensure that we as a species is protected from rogue AI agents will fall to global governments — whose leaders, hopefully, will heed the warnings. These warnings must be high on the agenda of the Albanese Government, which, hopefully, would exercise responsible control of the AI rush in Australia – but don’t bet on it.
There's been a lot of lip service from our government, which is tantamount to same inaction globally - so, there is reason to be concerned.
The reality: AI data centres have received a great deal of negative attention, but the likelihood that AI will eliminate thousands of jobs has received even far less attention. The 10 percent (or so) likelihood that AI will wipe out the human species hasn’t received nearly the attention it deserves.
So, as my American friend said to me in our telephone conversation two days ago: "A ten percent chance of extinction is too high for humanity to take no action."
Yet the risk of a climate crisis causing hundreds of thousands of premature deaths, destruction of ecosystems and species, and massive economic damage is 100%. And don't kid yourself, where're in the midst of it now - just take a good look around and you'll realise that it's happening in real time and will grow steadily worse with no endpoint, given the global failure to curb CO2 emissions.
The climate crisis is causing hundreds of thousands of premature deaths, the destruction of ecosystems and species, and massive economic damage. Data centres will only exacerbate the problem, so why is our government besotted by them - it's time to say NO to the tech giants.