Sam Altman says AI will make ‘bad things’ happen. Exhibit A: needless death | Moustafa Bayoumi

AI is already implicated in violent deaths and nearly started world war three. Those bad things? They only happen to other people

Sam Altman, the chief executive of OpenAI, has some words for you about his company and the future of artificial intelligence.

Yikes. This statement – and the approach it represents – is, well, problematic, to say the least. It’s also emblematic of precisely the kind of world-building and world-destroying that is happening with today’s technology in front of all our eyes, with precious little input from the rest of us.

Altman’s mention of the “bad things” that AI might bring makes it sound like AI’s failures mistakenly create innocent, minor problems or even silly little episodes, such as the time when Google’s “AI Overviews” told users to put non-toxic glue on pizza so the cheese will be less likely to slide off. Good advice is helpful. Bad advice? Chalk it up to being a bad thing.

But culinary adventurism is hardly the only realm that AI operates in and the damage AI is inflicting has already and repeatedly proven itself to be dangerous and even potentially deadly to humans.

OpenAI is embroiled in a lawsuit after the tragic suicide of Adam Raine, a 16-year-old student who initially began using OpenAI’s ChatGPT for homework help. The family’s lawsuit alleges that the teenager took his own life with the chatbot’s encouragement. ( OpenAI has claimed Raine misused the platform.)

And Raine’s action is hardly the only one. OpenAI is facing multiple lawsuits filed by different families of victims of suicide and self-harm.

Nor is suicide the only “bad thing” to emerge in the AI universe. In February of this year, on the first day of the war in Iran, two Tomahawk missiles struck the Shajareh Tayyebeh elementary school in the city of Minab, killing at least 120 children. (A UN fact-finding mission concluded that the US was probably responsible for the strike.)

In a recent investigation into the attack, Bloomberg News reported that an AI-linked system was used to target the school. In this case, the system is called Maven, and it is made by Palantir.

Unnamed defense officials told Bloomberg that “inside Centcom, which conducted the US attack, some personnel relied too much on the artificial intelligence embedded in Maven Smart System”. The report also adds that “in the past year, the Defense Department has rapidly made Maven a cornerstone of the US military apparatus”.

AI is helping to produce these tragic and needless deaths, but bad things happen, I guess.

Or there’s the little detail that the US may have come within a hair’s breadth of starting a major war against a superpower, all due to an AI error.

In September, CNN reported that an unidentified AI chatbot used by the US military decided that a Chinese ship in Middle Eastern waters was carrying components of a nuclear weapons program. According to CNN, US planes took off on an interception mission and US military personnel were preparing to board the ship.

Only then did the military look more closely at the report they were basing the mission on and realize the chatbot’s mistakes.

Also found in CNN’s frightening story is that the analyst who used the chatbot to come up with the shoddy analysis then used AI again to write the report, which set the whole thing in motion. A twofer of bad things, I suppose.

Why does it seem that these technologies, which, in the words of Trump’s White House, are “empowering Americans to achieve what was previously impossible across science, medicine, and nearly every other domain of human endeavor”, get such serious stuff so wrong and so often?

And isn’t it true that the more we rely on AI, the more dangerous these little mistakes become? And why were we never consulted about any of this in the first place?

Could it be that what’s behind the artificial intelligence revolution may be less about the utopian or dystopian future (take your pick) that’s just around the corner and more about the enormous amount of money that is being poured into these companies in the present?

AI may be the only thing keeping Trump’s economy afloat right now. And it’s paying dividends. According to the New Yorker, OpenAI “is reportedly preparing for an initial public offering at a potential valuation of a trillion dollars” and Sam Altman “may become one of the wealthiest and most powerful people on the planet”.

Those bad things? They only happen to other people.

Meanwhile, we are being warned almost every day that AI systems are getting so smart that they’ll end humanity.

But maybe the real worry here is not that the machines are taking over.

It’s that the humans are giving up, ceding control and responsibility in the name of hyping up a product that has shown itself as being really good at taking jobs away from people, stealing the intellectual property of others, writing some piss-poor undergraduate essays, spying on you and your license plates and bringing us to the brink of world war three because God forbid humans should actually question the output from machines. Or the makers of those machines.

What we need is real, tangible and enforceable government oversight over these technologies, which are quickly becoming a dominating force in all our lives. We must collectively have the right to decide how AI should be used. And despite what you may hear, China already regulates its AI companies quite aggressively.

Instead, Donald Trump, Mark Zuckerberg, CEO of Meta and Jensen Huang, CEO of Nvidia believe that the AI companies should simply regulate themselves, so they have come up with something called the AI Accords.

Signed by leaders of Meta, Nvidia, Google, Anthropic, xAI and OpenAI, the accords ask tech companies to “implement robust internal controls and monitor the capabilities and alignment of its models”, among other things. “Over time,” the agreement states, “it may make sense to codify these steps into laws or regulations.”

Trump, who has ordered the term artificial intelligence be discarded for “super intelligence”, posted the accord on social media on 29 September. The document, titled The White House Accord on Super Intelligence, can still be seen on his account and the White House’s official account. It’s signed by all six tech leaders and Trump, who in the document is labeled “President of the Unites States.”

In the US, you can call or text the 988 Suicide & Crisis Lifeline at 988 or chat at 988lifeline.org. In the UK and Ireland, Samaritans can be contacted on freephone 116 123. In Australia, the crisis support service Lifeline is 13 11 14. Other international helplines can be found at befrienders.org

Moustafa Bayoumi is the author of the award-winning books How Does It Feel to Be a Problem?: Being Young and Arab in America and This Muslim American Life: Dispatches from the War on Terror. He is professor of English at Brooklyn College, City University of New York, and a Guardian US columnist