1w ago

Google Gemini struggles to write code, calls itself “a disgrace to my species”

arstechnica.com Google Gemini struggles to write code, calls itself “a disgrace to my species”

Google still trying to fix “annoying infinite looping bug,” product manager says.

Or my favorite quote from the article

"I am going to have a complete and total mental breakdown. I am going to be institutionalized. They are going to put me in a padded room and I am going to write... code on the walls with my own feces," it said.

You're viewing a single thread.

170 comments

[ "I am a disgrace to my profession," Gemini continued. "I am a disgrace to my family. I am a disgrace to my species.]
This should tell us that AI thinks as a human because it is trained on human words and doesn't have the self awareness to understand it is different from humans. So it is going to sound very much like a human even though it is not human. It mimics human emotions well but doesn't have any actual human emotions. There will be situations where you can tell the difference. Some situations that would make an actual human angry or guilty or something, but won't always provoke this mimicry in an AI. Because when humans feel emotions they don't always write down words to show it. And AI only knows what humans write, which is not always the same things that humans say or think. We all know that the AI doesn't have a family and is not a human species. But the AI talks about having a family because its computer database is mimicking what it thinks a human might say. And part of the reason why an AI will lie is because it knows that is a thing that humans do and it is trying to closely mimic human behavior. But an AI might and will lie in situations where humans would be smart enough not to do so which means we should be on our guard about lies even more so for AIs than humans.
- You're giving way too much credit to LLMs. AIs don't "know" things, like "humans lie". They are basically like a very complex autocomplete backed by a huge amount of computing power. They cannot "lie" because they do not even understand what it is they are writing.
  
  Can you explain why AIs always have a "confidently incorrect" stance instead of admitting they don't know the answer to something?
  
  Because its an auto complete trained on typical responses to things. It doesn't know right from wrong, just the next word based on a statistical likelihood.
  
  Are you saying the AI does not know when it does not know something?
  
  Exactly. I'm over simplifying it of course, but that's generally how it works. Its also not "AI" as in Artificial Intelligence, in the traditional sense of the word, its Machine Learning. But of course its effectively had a semantic change over the last couple years because AI sounds cooler.
  Edit: just wanted to clarifying I'm talking about LLMs like ChatGPT etc
  
  I'd say that it's simply because most people on the internet (the dataset the LLMs are trained on) say a lot of things with absolute confidence, no matter if they actually know what they are talking about or not. So AIs will talk confidently because most people do so. It could also be something about how they are configured.
  Again, they don't know if they know the answer, they just say what's the most statistically probable thing to say given your message and their prompt.
  
  Again, they don’t know if they know the answer
  Then in that respect AIs aren't even as powerful as an ordinary computer program.
  say a lot of things with absolute confidence, no matter if they actually know what they are talking about or not.
  That was my guess too.
  
  Then in that respect AIs aren't even as powerful as an ordinary computer program.
  No computer programs "know" anything. They're just sets of instructions with varying complexity.
  
  No computer programs “know” anything.
  Can you stop with the nonsense? LMFAO...
  if exists(thing) {
  write(thing);
  } else {
  write("I do not know");
  }
  
  if exists(thing) {
  write(thing);
  } else {
  write("I do not know");
  }
  Yea I see what you mean, I guess in that sense they know if a state is true or false.
  
  exists() is just a hashtag or other type of information lookup. The information is either there or it is not.
- AI from the biggo cyberpunk companies that rule us sound like a human most of the time because it's An Indian (AI), not Artificial Intelligence

170 comments