GPT for All: Hacked! No signups, logging in.

I had an interesting result.

I proposed a simple question like I did all the other AI with "airoboros-65B-gpt4-1.4-GPTQ for 13 kudos in 369.6 seconds". It was a bit of a wait, I understand why.

It gave me a word for word comment on what I assume is a blog post from a Melissa. The topic was related, just barely.

Which LLM do you recommend for questions about a subject? I looked in the FAQ to see if there was a guide to the choices.

Just tested. Thanks for building and sharing!

Aren't KobaldAI models on par with GPT3? Why not just use ChatGPT then?

AI Horde looks dope for image generation though!

Checking it out, how come I can't paste my api key in the field on the option tab? I gotta type it out?

I don't know if anyone will read this but I did further testing on perplexity when I got home. It's probably not the right spot for it.

I tried a more trickier question and then I chose the available prompts to move forward (it suggests questions related to the original question if you are unsure how to prompt it next). The prompts were intelligent and were probably the next question I would assume I would ask if I were learning about this topic. On the next answer, it literally quoted something I wrote, almost word for word, on the exact subject which, according to me (of course) would be the correct answer.

I've never had an AI even reference a single thing I've written. I had prompted it into a general area where the things I had wrote existed so it should be expected but it made the connection almost instantly and answered the question 100% accurately.

As much as I hate it, well done Skynet.

Edit: After further testing, I can catch it out regularly enough but still, if I had to tell someone about the topic generally via email, I'd probably recommend it rather than me waste time typing it all out. I've just put myself out of a job.

and the title. Hacked? what's being hacked here? they're all using GPT in the backend.

maybe bot votes? ㄟ(ツ)ㄏ

@ChatGPT@lemmings.world Say hi!

It compares more to a GPT-3 not-so-good model.

I've tinkered with a Discord bot using the official gpt3.5 API. It's astonishingly cheap. Using the 3.5-turbo model, I've never cracked $1 in a month and usually am just a couple cents a week. Obviously this would be different if you're running a business with it or something, but for personal use like answering questions, writing short blurbs, and entertaining us while drunk...it's not bad at all in my experience.

You're billed per token usage. GPT-3.5-Turbo price per 1K tokens is quite low now.

I kinda made my own Custom ChatGPT with Python (and LOTS of coding help from Web CharGPT). It evolved from a few lines shitty script to a version that uses Langchain and has access to custom tools, including custom data indexes and has a persistent memory.

What will ramp up the cost are things like how much context (memory) you want the chatbot to have. If you use something like a recursive summarizer, that summarizes a text by chunks over and over until the text is below a set length, that also uses many API calls that consume tokens. Also, if you want your chatbot to use custom info that you provided to it, solutions like LlamaIndex are easy to use, but require quite some tokens per query.

On my worst month, with lots of usage due to testing and without the latest price drop, I reached 70$.

Of the language models you can run locally, I’ve found them to be awkward to use and not perform too well. If anyone knows of any newer ones that do a better job I’d love to know.

like this ?