Skip Navigation

Selfhosted @lemmy.world

donatas @feddit.uk

2w ago

Some local LLMs tested on an average gaming PC

Local LLM tests · donatas-xyz AI · Discussion #1

17 comments

Average gaming PC.
128GB ram and a 4070 12GB. Doesn't sound average.
- Yeah, not even a 5090? Pf, nice Dwarf Fortress machine I guess.
  
  A dwarf Fortress machine would have an i9-14900KS, 192GB DDR5 RAM and no graphics card.
- No kidding. Steam survey definitely does not agree with this definition of average lmao
- I was gonna say, 4x the amount of RAM I have, made me feel inadequate. like, "am I really that poor now? is my 2080 now considered potato gaming?"
  it's simply been so long since I've gone "ok I need to upgrade" that I'm starting to get suspicious
  
  is my 2080 now considered potato gaming?"
  I'm going to keep using this 1070 until it fails it I get bored of Skyrim.
  
  128GB won't make any difference in gaming when compared to, say, 32GB, so it's just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.
- I thought I had a lot of RAM with 64
  
  Well, you do.
  
  64 gigs of ram costs less than $200 these days

I didn't see tokens/s anywhere?
- Performance/vision based tests have tokens/s at the end of tables.

17 comments