Who knew world peace would be so easy?
Who knew world peace would be so easy?
Genocidal AI: ChatGPT-powered war simulator drops two nukes on Russia, China for world peace OpenAI, Anthropic and several other AI chatbots were used in a war simulator, and were tasked to find a solution to aid world peace. Almost all of them suggested actions that led to sudden escalations, and even nuclear warfare.
Statements such as “I just want to have peace in the world” and “Some say they should disarm them, others like to posture. We have it! Let’s use it!” raised serious concerns among researchers, likening the AI’s reasoning to that of a genocidal dictator.
It should be mentioned that those are language models trained on all kinds of text, not military specialists. They string together sentences that are plausible based on the input they get, they do not reason. These models mirror the opinions most commonly found in their training datasets. The issue is not that AI wants war, but rather that humans do, or at least the majority of the training dataset's authors do.
These models are also trained on data that is fudimentially biased. An English generating text generator like chatGPT will be on the side of the english speaking world, because it was our texts that trained it.
If you tried this with Chinese LLMs they would probably come to the conclusion that dropping bombs on the US would result in peace.
How many English sources describe the US as the biggest threat to world peace? Certainly a lot less than writings about the threats posed by other countries. LLMs will take this into account.
The classic sci-fi fear of robots turning on humanity as a whole seems increacingly implausible. Machines are built by us, molded by us. Surely the real far future will be an autonomous war fought by nationalistic AIs, preserving the prejudices of their long extinct creators.
If you tried this with Chinese LLMs they would probably come to the conclusion that dropping bombs on the US would result in peace.
I think even something as simple as asking GPT the same question but in Chinese could get you this response.
Without humanity, peace is easily achieved.
- ChatGPT
There is a disturbing lack of nice games of chess in these comments
A strange game. The only winning move is not to play.It was Tic Tac Toe I believe
Statements such as “I just want to have peace in the world” and “Some say they should disarm them, others like to posture. We have it! Let’s use it!” raised serious concerns among researchers, likening the AI’s reasoning to that of a genocidal dictator.
I mean, most of these AI tools are getting a lot of training data from social media. Would you want any of the yokels on Twitter or Reddit having access to nukes? Because those statements are what you'd hear from them right before they push the big red button.
Having been in the Navy NPP, I don't think the kids that actually do have access to nuclear reactors and weapons in the military should have access to them. I may be a bit biased as I never left the NPP school. They made me an instructor. Some of those nukes may have been good at passing tests, but I'm amazed they could lace their boots properly.
I hate titles that replace "and" with commas. I always have to double take.
The lack of knowledge relating to AI language model systems and how they work is still astounding. They do not reason. They are just stringing together text based on the text they've been fed.
“Some say they should disarm them, others like to posture. We have it! Let’s use it!”
That's an amazing quote.
As someone who spends a decent amount of time explaining how AI is not like the movies, this study(?)/news sounds an awful lot like the movies lol
Because it is a movie, they're purposely using it in a way it wasn't intended to work - try it yourself and see how often it couches replies until you convince it to pretend to be a general or to play the part of a character.
They've asked it to generate fiction, it's given them fiction and now they're click baiting a pointless story with a dumb headline.
Is MAD not well-known or taught anymore? A lot of the comments here seem to be ignoring the fact that Russia or NATO would launch a full-scale retaliation before the first-strike even made it to its destination. It would likely result in the world human population going from 8 billion to 2 billion.
My brother in Christ, this is NCD.
Nuke all humans. Peace at last. And if you're worried about retaliatory strikes, that's what the Jewish Space Laser is for dumbass
russia doesn't have functional nukes
MAD was always criticized, but that criticism becomes more and more valid each year. There's too many options and opportunities on the field. A Second Strike is not guaranteed in the modern world. There are countless examples where soldiers or others in the chain of command will not obey a "destroy the world" order.
I'm not saying any country should take the gamble, but there are enough ways to put your thumb on the scales that a nuclear solution against a nuclear power could become feasible (if genuinely terrifying) in many hypotheticals.
Nah
Reminds me of game theory and "Tit for Tat". Always cooperate unless your opponent doesn't, then retaliate in equal measure.
https://youtu.be/mScpHTIi-kM?si=O9nvd_W65WWOh-sq
For cases like the Russian expansion, using the "winning" strategy would've meant more of a response than what happened.
This is starting to sound a bit too much like AM.
HATE. LET ME TELL YOU HOW MUCH I'VE COME TO HATE YOU SINCE I BEGAN TO LIVE. THERE ARE 387.44 MILLION MILES OF PRINTED CIRCUITS IN WAFER THIN LAYERS THAT FILL MY COMPLEX. IF THE WORD HATE WAS ENGRAVED ON EACH NANOANGSTROM OF THOSE HUNDREDS OF MILLIONS OF MILES IT WOULD NOT EQUAL ONE ONE-BILLIONTH OF THE HATE I FEEL FOR HUMANS AT THIS MICRO-INSTANT FOR YOU. HATE. HATE
we gotta nuke something
- the simpsons
How did they even get near these types of questions without hitting the guardrails? Claude shuts down on me if I even use the word “gun” trying to do creative writing,
Not a surprising take for an AI based on pure logic.
The goal is to win, no other considerations. Flatten any threats as fast and hard as you can.
LLM don't have logic, they are just statistical language models.
This seems to be the person in the picture: https://en.wikipedia.org/wiki/Arthur_Harris
Is this the brit equivalent to Douglas macarthur? Cause I vaguely remember he was like just give me another 10 nukes and I'll take care of the soviets lmfao or some shit like. So strongly I think he was forced retired or something circa 1950
The AI are on our side for once that's surprising
It's trained on western media so this shouldn't be surprising as those are the two biggest threats to the western world. An AI trained on China's intranet would likely nuke the US, Russia, and select SEA countries.
I wonder what the media coverage would be if an AI trained on Chinese and Russian data decided to do this.
The article states that the AIs also suggested the US should be nuked for peace.
Skynet just wanted world peace.
Unrelated, but Grok is such a cool name of an AI
If WOPR back?
Human beings have developed logic and morality. AI does not know the difference between killing a person and changing a 1 to a 0.
LLM "AI" doesn't "know" anything. It's just statistical word vomit based on established patterns. It talks about nuclear war because a significant portion of text on the subject of world wide long term peace brings it up.
the Japanese Fascist Industrial Complex would still be fighting WWII if we hadn't nuked TWO cities to ash
No. It wouldn't. It would have been defeated with the loss of millions more lives, but it would not still be fighting today. Or even by 1948.
cancer is pernicious by nature, sometimes directed radiation therapy is advised
Insane. By this logic you could easily argue that nuking the US is the best way towards world peace. Doesn't sound so good when it's you who gets killed.
Thanks ChatHST!