For the first time in my life I own a PC with a reasonable powerful dedicated graphics card. It's the Nvidia RTX 3060 with 12GB VRAM. I know it's older and so on but before that I only had laptops and integrated GPUs which were not very powerful.
I bought it specifically to edit videos and it works very well for it. But I edit videos perhaps once a month and the rest of the time the GPU is practically idling.
What I found is that I can run up to 14b big LLMs on it, so I set it up and am using it for that too, and it's really a lot of fun which I didn't quite expect.
And therefore I'm wondering what other fun things I could do with this graphics card, any tips?
Gaming is not very entertaining to me, I do it even more seldom than video editing, so I'm looking for other things.
I mean their main use case is gaming... And you can do a few more AI things, LLMs aside. For example generate pictures, voice cloning (or changing), you can have a vtuber avatar and do live-streams as an anime girl. Or run Jupyter Notebooks with arbitrary machine learning projects. Do virtual reality. Or run a big CAD program and design some objects. Maybe even run finite element method simulations to see how your workpiece will deform with stress...
I bought a course from udemy to learn it, helps cause you can follow along in an organized order. I actually haven't touched it much since but it was fun to go through. Just make sure to buy their courses on sale if you do, otherwise they can get pretty pricey.
Adjacent to video editing, do you have any interest in visual effects? Lots of really sophisticated CGI and other VFX in film can be done from consumer-grade GPUs like yours.
Go download ComfyUI (civitai is a good source of models) and Blender. A snappy cycles viewport is something to behold. Do simulation nodes run on GPU? If they do you can do all kinds of stuff with that.
Oh, wow, I didn't realize that would be so much fun! And it's somehow faster than the ones online too, and you can really do a lot with all the different models you can download!
It's been a while since I played with it, but the Dynamic Prompts extension has some options for creating random prompts and combinations. It's neat to have it run through a hundred images to see what it creates, find the interesting ones, and then focus on that prompt for some more refined images. Or upscale and inpaint/outpaint the ones you want.