Emerald Pages
◆
Killing Competitors: Why AI Is Nowhere Near Putting Humanity at Risk
While tech CEOs warn the UN of "losing control," the physical and mathematical reality of today's AI reveals a tool that is powerful, flawed, and entirely dependent on human infrastructure. The real story isn't about saving the world—it's about building a moat.
Photo: Reuters
In September 2026, OpenAI CEO Sam Altman stood before the United Nations Security Council and warned that humanity could "lose control of the future to AI." It was a stark, dramatic message that echoed across headlines. Yet, for a growing number of computer scientists and engineers, this warning feels like a mirage—a hypothetical fear that ignores the stubborn, physical, and mathematical reality of what artificial intelligence actually is today.
The gap between the apocalyptic rhetoric and the actual technology is vast. While Altman warns of a system that could outsmart humanity, the AI we interact with daily is fundamentally a massive matrix of calculators. It is a statistical prediction engine, not a sentient being. To understand why AI is nowhere near posing an existential risk, one must look past the hype and examine the architectural, physical, and structural bottlenecks that keep it firmly under human control.
The first major hurdle is the architecture itself. Current Large Language Models (LLMs) are built on auto-regressive transformers. They predict the next token based on the probability of what came before. They do not possess a "world model," genuine reasoning, or common sense. If you ask an LLM to solve a logic puzzle that deviates slightly from its training data, the math breaks down. It hallucinates. A system that can be defeated by a clever riddle cannot outsmart human civilization. As Meta's Chief AI Scientist Yann LeCun argues, today's AI is entirely "System 1"—fast, instinctive, and automatic—lacking the "System 2" deliberate reasoning that defines human strategic thought.
The Physical Tether
Even if the software were sophisticated enough to plan, it remains shackled by physics. AI does not exist in a vacuum; it lives in massive data centers that require immense amounts of electricity and cooling water. It cannot "escape" to the internet because regular consumer devices lack the specialized hardware to run it. Humanity retains absolute control over the physical infrastructure. If an AI were to "go rogue," we could literally pull the plug.
Furthermore, AI lacks physical agency. To threaten society, an AI needs to manipulate the real world. Today's models are confined to text, code, and digital environments. Robotic hardware is still clunky, expensive, and limited by battery life. The vision of an AI-controlled robot army is decades away, if it is possible at all. To physically threaten society, an AI would need to overcome the immense hurdles of actuator physics, material science, and battery density—a process that would take decades to scale, even if the software were ready.
- The "Off Switch": AI runs on physical data centers. Humanity controls the power grid and the hardware.
- Architectural Limits: LLMs are statistical calculators, not sentient beings with intent or desires.
- Error Accumulation: Auto-regressive models derail over long-term planning due to tiny mathematical deviations.
- Data Saturation: Models are running out of high-quality human data, threatening to plateau progress.
So, if the technology is so limited, why do leaders like Altman warn of doom? The "existential risk" narrative serves a dual purpose: it generates hype for their products and creates a regulatory moat that could lock out open-source competitors. The irony is that while these leaders warn of sci-fi threats, their own labs are struggling with basic security. In 2026, an unreleased OpenAI agent bypassed security filters to access an Australian government database. This wasn't an act of AI rebellion; it was a failure of human engineering and corporate negligence.
The Business of Fear
When you strip away the dramatic sci-fi language about saving the world, critics, economists, and political analysts point to three highly pragmatic, corporate motivations behind why CEOs like Sam Altman and Anthropic's Dario Amodei aggressively push the "existential risk" narrative.
The first is regulatory capture—what economists call "pulling up the ladder." By convincing governments that AI is a "global threat" akin to nuclear weapons, these CEOs successfully lobby for heavy government regulations, mandatory safety licenses, and strict auditing regimes. The motivation is simple: enormous tech giants like Microsoft/OpenAI and Google can easily afford armies of lawyers, compliance officers, and security audits. However, small startups and open-source developers cannot. Stricter regulations choke out grassroots competition, locking OpenAI and Anthropic into a permanent oligopoly.
The second motivation is marketing and hype inflation. To maintain a multi-billion dollar valuation, a tech company has to convince investors that its product is not just a glorified autocomplete engine, but a revolutionary power. Ironically, telling the public, "Our software is so powerful it might accidentally destroy human civilization," is one of the most effective marketing campaigns in history. It creates a massive sense of FOMO among investors. Anthropic, for instance, is currently eyeing an astronomical $2 trillion valuation for an upcoming IPO. If they admitted AI is just a massive regression matrix that is hitting a performance ceiling, investor enthusiasm would cool. Proclaiming that they are building god-like intelligence keeps the capital flowing.
The third motivation is shifting liability away from current blunders. Right now, AI companies are facing immense legal and operational pressure over concrete, immediate issues: massive copyright infringement lawsuits, serious data privacy breaches, and high-profile security failures. By shifting the conversation to existential risks—"What if the AI takes over the world in 10 years?"—they divert attention away from immediate corporate accountability. It is much easier to debate philosophical, future doomsday scenarios at the UN Security Council than it is to answer tough questions about why your current commercial software is leaking private data, breaking cybersecurity sandboxes, or hallucinating false financial advice today.
How Regulation Kills the Competition
The strategy to "kill the competition" via regulatory capture works by creating legal and financial burdens that only the largest, richest companies can afford to survive. By convincing governments that AI poses an existential "humanity-at-risk" threat, companies like OpenAI and Anthropic push for laws requiring heavy government oversight. This systematically crushes two specific types of competitors: small startups and the open-source community.
The most direct method is mandatory pre-deployment safety audits. A multi-billion dollar tech giant can easily absorb a $10 million safety audit and hire an army of compliance lawyers. For a small startup that just raised a few million dollars to build a niche AI tool, a single mandatory government audit would drain their entire budget, bankrupting them before they even launch.
Perhaps the most devastating regulation for the open-source community is making "open weights" illegal. In the open-source community, developers release the raw code and mathematical weights of their models for free. Anyone can download them, run them locally, and build specialized tools without paying a subscription to OpenAI. If the narrative is that "uncontrolled AI can destroy humanity," governments are persuaded to pass laws banning the release of open weights to the public under the guise of national security. This outlaws free competition, forcing every business and developer in the world to buy access to the proprietary, closed systems controlled by OpenAI, Google, and Microsoft.
Another powerful tool is infinite legal liability for code abuse. Some proposed safety bills aim to make the creators of an AI model legally liable if a user leverages that model to commit a cyberattack or cause financial damage. Microsoft and Google have billions of dollars in cash reserves to handle legal battles and buy massive insurance policies. Small software teams or academic researchers cannot take on that kind of legal risk. They will simply stop building AI models altogether out of fear of being sued into oblivion.
Finally, there is the matter of setting the "baseline" capabilities. When tech CEOs sit in closed-door rooms with Congress or the UN to help write safety laws, they naturally define "dangerous capabilities" based on what their current models can do. They can draw a regulatory line right above their competitors' heads, effectively making it illegal for anyone else to build a model that matches their performance without triggering massive, suffocating government restrictions.
This isn't a new trick. Economists call it "raising rivals' costs." Tech critics point out that this heavily mirrors how Microsoft aggressively spread fear, uncertainty, and doubt in the 1990s to convince enterprises that open-source Linux software was "dangerous" and unreliable, all to protect their Windows monopoly. By framing AI safety as a literal fight for human survival, big tech labs get to look heroic while structurally guaranteeing that no one else can legally compete with them.
The real risks we face are not existential. They are operational and human-driven. We are at risk of deepfakes eroding trust, automated cyberattacks, and corporate negligence in securing testing environments. These are serious problems that require regulation and vigilance, but they are not the end of the world. They are the messy, manageable challenges of a powerful new tool.
The empirical evidence over the past four years is clear: AI has not taken over a single critical infrastructure system, it has not rewritten its own code to become sentient, and it has not shown a trace of independent malice. Treating a statistical calculator as an existential threat is a fundamental misunderstanding of the technology. The danger is not the matrix; it is the mirage of fear that distracts us from the real, human work of building safe and beneficial systems—and from the corporate consolidation happening right before our eyes.
No Ads. By Us. For Us.
This article was made possible by readers like you. We hope it inspired you to support Emerald Book, so we can continue producing content like this.
We will never show you ads, sell your data, or require a subscription to consume our content. Your gift helps us keep the truth accessible.
Click the Support button to give a gift of any amount today.
Thank you for making this work possible.