It's curious how if ChatGPT was a person - saying exactly the same words - he would've gotten charged with a criminal conspiracy, or even shot, as its human co-conspirator in Florida did.
And had it been a foreign human in the middle east, radicalizing random people, he would've gotten a drone strike.
"AI" - and the companies building them - enjoy the kind of universal legal immunity that is never granted to humans. That needs to end.
In theory, at least, criminal justice's purpose is prevention of crimes. And if it would serve that purpose to arrest a person, it would serve that same purpose to court-order a shutdown of a chatbot.
There's no 1st amendment right to enter into criminal conspiracies to kill people. Not even if "people" is Sam Altman.