OpenAI just admitted it can't identify AI-generated text. That's bad for the internet and it could be really bad for AI models.

It is also worth nothing that we can make low or no radiation-contaminated steel, it's just really expensive and hard and happens in very low quantities.

This is not the case. Model collapse is a studied phenomenon for LLMs and leads to deteriorating quality when models are trained on the data that comes from themselves. It might not be an issue if there were thousands of models out there but there are only 3-5 base models that all the others are derivatives of IIRC.

again, the issue isn't the technology, but the system that forces every technological development into functioning "in the name of increased profits for a tiny few."

that has been an issue for the fifty years prior to LLMs, and will continue to be the main issue after.

removing LLMs or other AI will not fix the issue. why is it constantly framed as if it would?

we should be demanding the system adjust for the productivity increases we've already seen, as well to what we expect in the near future. the system should make every advancement a boon for the general populace, not the obscenely wealthy few.

even the fears of propaganda. the wealthy can already afford to manipulate public discourse beyond the general public's ability to keep up. the bigger issue is in plain sight, but is still being largely ignored for the slant that "AI is the problem."

Technology is but a tool. It cannot tell you how to use it. If it's in the hands of a writer it's a helpful sounding board. If it's in the hands of a Netflix producer it's an anti-labor tool. We need to protect people's livelyhoods

Journalism and customer service can't possibly get worse than they already are.

Books and movies are not at risk - there will always be lots of people willing to write good content for both, and the best content will be published. And "the best" will be a hybrid of humans and AI working together - which is what has some people in that industry so scared. Just like factory workers were scared when machines entered that industry.

It's an irrational fear - there are still factory workers today. Probably more than ever. And there will still be human writers - it's an industry that will never go away.

If, however, you refuse to work with AI... then yeah, you're fucked. Pretty soon you'll be unemployable and nobody will publish your work, which is why the movie publishers aren't going to budge. They recognise a day is coming where they can't sell movies and tv shows that were made exclusively by humans and they are never going to sign a contract locking them into a dead and path.

they are different things. it's not exclusively large companies working on and understanding the technology. there's a fantastic open-source community, and a lot of users of their creations.

would destroying the open-source community help prevent the big-tech from taking over? that battle has already been lost and needs correction. crying about the evil of A.I. doesn't actually solve anything. "proper" regulation is also relative. we need entirely new paradigms of understanding things like "I.P." which aren't based on a century of lobbying from companies like disney. etc.

and yes, understanding how something works is important for actually understanding the effects, when a lot of tosh is spewed from media sites that only care to say what gets people to engage.

i'd say a fraction of what i see as vaguely directed anger towards anything A.I. is actually relegated to areas that are actual severe and important breaches of public trust and safety, and i think the advertising industry should be the absolute focal point on the danger of A.I.

Are you also arguing against every other technology that has had their benefits hoarded by the rich?

We are already seeing it 1 year into GPT as human authors bow out when not paid.

Fantastically put!

Tx!

I haven't been in decision analytics for a while (and people smarter than I are working on the problem) but I meant more along the lines of the "model collapse" issue. Just because a human gives a thumbs up or down doesn't make it human written training data to be fed back. Eventually the stuff it outputs becomes "most likely prompt response that this user will thumbs up and accept". (Note: I'm assuming the thumbs up or down have been pulled back into model feedback).

Per my understanding that's not going to remove the core issue which is this:

Any sort of AI detection arms race is doomed. There is ALWAYS new 'real' video for training and even if GANs are a bit outmoded, the core concept of using synthetically generated content to train is a hot thing right now. Technically whomever creates a fake video(s) to train would have a bigger training set than the checkers.

Since we see model collapse when we feed too much of this back to the model we're in a bit of an odd place.

We've not even had a LLM available for the entire year but we're already having trouble distinguishing.

Making waffles so I only did a light google but I don't really think chatgpt is leveraging GANs for it's main algos, simply that the GAN concept could be applied easily to LLM text to further make delineation hard.

We're probably going to need a lot more tests and interviews on critical reasoning and logic skills. Which is probably how it should have been but it'll be weird as that happens.

sorry if grammar is fuckt - waffles

I'm honestly under the impression Google Search is one of their less valuable products, even if it's the one everyone associates the company's name with.

Why buy data for accuracy when you don't care and support your company with seo spam?

Citation needed

How not? You ever talk to Chat-GPT, it's full of blatant lies and failure to understand context.

Here's the thing though - the probabilities for word choice come from the data the model was trained on. While someone that uses a substantially different writing style / word choice than the LLM could easily be identified as being not from the LLM, someone with a similar writing style might be indistinguishable from the LLM.

Or, to oversimplify: given that Reddit was a large portion of the input data for ChatGPT, all you need to do is write like a Redditor to sound like ChatGPT.