Linux May Be the Best Way to Avoid the AI Nightmare
Linux May Be the Best Way to Avoid the AI Nightmare

Linux May Be the Best Way to Avoid the AI Nightmare

Linux May Be the Best Way to Avoid the AI Nightmare
Linux May Be the Best Way to Avoid the AI Nightmare
It's not AI that is the problem, it's half baked insecure data harvesting products pushed by big corporations that are the problem.
The biggest joke is that the LLM in Windows is running locally, it uses your hardware and not some big external server farm. But you can bet your ass that they still use it to data harvest the shit out of you.
To me this is even worse though. They're using your electricity and CPU cycles to grab the data they want which lowers their bandwidth bills.
It happening "locally" while still sending all the metadata home is just a slap in the face.
That's a pretty big joke, but I think the bigger joke is calling LLMs AI. We taught linear algebra to talk real pretty and now corps want to use it to completely subsume our lives.
Runs locally, mirrors remotely.
To ensure a seamless customer experience when their hardware isn't capable of running the model locally or if there is a problem with the local instance.
microsoft, probably.
That is an accurate description of AI in common usage even if it isn't an inherent aspect of AI.
Right, but AI is not the only way they're doing the data collection.
Locally run AI could be great. But sending all your data to an external server for processing is really, really bad.
You wrote AI twice.
It's not the "AI nightmare", it's a nightmare of capitalism, proprietary software and user-hostile behavior by a greedy, profit-extracting Big Tech corporation.
All true, and all a problem for which linux has been a solution (in the computing world) for decades now.
It's not just Linux, but free & open source software in general. And it's not just desktop PCs that are plagued by this corporate spyware, it's much worse when looking at the mobile device landscape. The only real solution for mobile devices is GrapheneOS with FOSS software installed from the F-Droid marketplace. Browsers are also under attack by proprietary software corporations, Google just intentionally broke adblockers on all Chromium-based browsers, so they can generate more ad revenue. Last year, they tried to push a proposal that would have massively extended their monopoly on web browsers (WEI). All the streaming services are screwing their users over and increasing the subscription prices while making the content library smaller. It's such a fucking scam, and it's almost sad to see how many people are dumb enough to fall for it.
Praise Stallman
You’re not wrong. AI is just another tool to scrape cash to the top while eliminating jobs. Could it realize benefits like doing specialized research and testing? Sure…but again, the results of that work are lost human jobs and scraping money to the top. We can argue about advancing technology in a horse cart driver vs automobile thing (won’t anyone think about the poor farriers out of work?) but we’ve already done everything we can to eliminate blue collar jobs with as much automation as possible. Now AI is set to attack middle class jobs. Economically I don’t think that’s going to work out well.
I mean, the problem isn't the existence/obviation of jobs, but what we do next when it happens. If the people whose jobs are automated away are left out with no money or employment, that's a serious problem. If we as a society support them in learning something new that puts their skills to good use, and maybe even reduce the expected working hours of a full-time job to 35 or 32 hours a week, that's an absolute win in my book.
But as someone pointed out elsewhere....AI can already take over the job of company CEOs.... decision making tools could make a group of technical people be more effective than a CEO as we know today.
I find the nightmare getting a lot more noticeably bad with LLMs, though. That's not just correlation.
AI is a cool feature, which makes a great excuse for proprietary corporations to spy on their users. I'd say it's one of the best opportunities for an excuse of the last few decades. Only 9/11 was a better excuse to put everyone under corporate/government surveillance.
"The Year Of Linux on Desktops". Been hearing this for decades, but it might actually be happening. What I'm feeling now is the same thing I felt when Mozilla originally split Firefox out, and made the first real competition to corporate browsers as a free product. People don't want all this bullshit, and want to retain control over the machines they are working on. Seems a lot more people are interested in FOSS environments now just to avoid all the other BS they hate getting shoveled at them.
“The Year Of Linux on Desktops”. Been hearing this for decades, but it might actually be happening.
Been hearing this for decades.
And it won’t ever be true until you can pick up a PC running Linux in a big box store. I could see the Steam Deck (and Valve’s rumoured upcoming console) to make a dent in the PC gaming space, but it won’t make a difference to the purchasing decisions of your your aunt who uses her pc to check her emails.
Should corporate buyers ever get tired of MS’ shenanigans they might switch over to Ubuntu, but I’m not holding my breath for that.
Decades ago it was a funny joke. Now it's the most popular handheld OS on the planet by a huge margin. Linux is damn EVERYWHERE except the desktop now, and it's only a matter of time.
Been hearing this for decades.
I've been hearing this about people hearing about people hearing that about Linux for decades.
We can dream 😔
Seems like we’ll get financially viable fusion power plants before that happens.
I don't see a "year of the Linux desktop" happening, but rather its share growing slowly over the years. Windows would probably not have one big event that ends its dominance, but it can be a death of a thousand cuts.
Guess which OS won't be recognized as a "trusted environment" to visit websites with down the line in Google's upcoming Web DRM. For your own protection of course...
I can easily believe these types of continued enshittification will help drive more users to Linux desktop usage. But that will still be a small percent.
People have to know and care about the problem and then be willing to put in the effort to understand what to do. That combination is pretty limiting.
I'd love to be proven wrong, though.
I think it might. Demographics are changing to make PC users more technical overall. The casual user isn’t looking to purchase a desktop PC. Casual is now synonymous with mobile.
It used to be that you needed a desktop to do your taxes or make an insurance claim over the Internet. That’s just not true anymore.
The counterpoint are people like this, the feature they want is built on extreme data gathering. https://lemmy.world/pictrs/image/a8fec90b-c349-46c9-8592-5dbe17ea4c8c.jpeg
Technically you could have such data gathered and stored locally, without sending them to big corpo. Privacy friendly "AI" is very much possible, it's just not favorable to those companies because they see those models as a tool and the data as what ends up making them money.
People may not want it but most don't know, care enough to adjust, or are just generally complacent. I mean, I DO care and find it hard to move to Linux due to lack of support for some of my work tasks.
Most things MOST people work on these days aren't heavily tied to Windows as an OS in a way that would prevent it running via emulation. Worst-case, in a VM. Lots of the everyday things people use is in the browser now.
You have an example?
I'm not so sure that the laypeople will, but I do expect a shift. Personally I'm still running Windows 10 next to Linux currently. Most of my time is still spent on Windows, because it's generally a bit more stable and hassle free due to the Windows monopoly. Software is written for Windows, so sadly it's usually just a better experience.
But so many things I read about Win 11 (and beyond) piss me off. It's my computer, I don't want them to decide things for me or farm my data. I'm mentally preparing for the transition to Linux-only. 90% of the software I use will work out of the box, and I think with some effort I can get like 8% of the rest to work. It'll be a lot of effort, but Micro$oft has pushed so far that I'm really starting to consider.
Multiple friends and colleagues (all programmers) I spoke are feeling the same way. I think Linux may double in full-time desktop users in a few years of this goes on.
Firefox is like 2.8% of browser market share, so if that's our baseline then Linux is already beating it by a mile.
It's not about the total share, it's about the premise.
The combined ages of my children taken from 2024 would not equal the first year I heard that Ubuntu would take over the market.
For me the year of the Linux desktop was 2014 - it's when I changed my desktop to Linux after using it on my laptop for a year. All the hardware on that machine has been replaced, but it's still running the same install from back then.
People keep pointing the finger at AI, but miss the fact that the problem is corporate greed. AI has the possibility to help us solve problems, corporate greed will gate keep the solutions and cause us suffering.
Sure. But then, Linux may well be a solution against corporate greed.
Linux is a solution against corporate greed, it directly takes market share away from Microsoft, and is a viable competitive alternative with few drawbacks.
I want all the cool Ai shit, but I want to be in charge of it 100%. I don't want a data mining company with an OS side project spying on me for profit.
Enshittification is the result of the user not being in control: markets have a natural tendency to become dominated by a few companies (or even just a single one) if they have any significant barriers to entry (and said barriers to entry include things like networking effects), and once they consolidate control over a large enough share of the market those companies become less and less friendly and more and more extractive towards customers, simply because said customers don't actually have any other options, which is what we now call enshittification.
At the same time Linux (and most Open Source software) is mainly about the owner being in control of their own stuff, not some corporate provider of software for your hardware or of a hardware + software "solution" (i.e. most modern electronics) provider.
So we're getting to see more and more Linux-based full solutions to take control of one's devices back from the corporations, not just Linux on the Desktop to wrestle control back from an increasingly anti-customer Microsoftw, but also, for example, stuff like OpenELEC (for TV boxes) and OPNSense (for firewalls/router).
LLMs in particular are unlikely to solve really any problems, much less a measurable number of the problems it is currently being thrown at.
I mean, if LLMs really make software engineering easier, we should also expect Linux apps to improve dramatically. But I’m not betting on it.
Tell that to the code I have it write and debug daily. I was skeptical at first, but it's been a huge help for that, as well s learning new (development) languages.
It's not greed - it's masqueraded violence being allowed, centralization, impunity, and general corruption, all supported by various IP, patent and "child protection" laws.
No separate component is necessary, it's a redundant system built very slowly and carefully.
Referencing that quote about blood of patriots, and another about difference between journalism and public relations being in outrage and offense, or difference between a protest and a demonstration being in obviously breaking rules.
EDIT: I meant - it's a general tendency. But IT today is as important as police station, post office and telegraph were in 1917. One can also refer to that "means of production" controversy.
People keep pointing the finger at AI, but miss the fact that the problem is
corporate greedcapitalism. AI has the possibility to help us solve problems,corporate greedcapitalism will gate keep the solutions and cause us suffering.
No need to thank me.
We don't have capitalism in the US, we have late-stage crony capitalism. Regulated capitalism is fine, but we are in a crony capitalist system which feeds corporate greed. Our government is controlled by a handful of mega corps which have their hands pulling the strings due to the lobbying system. It wasn't always this way, which is why I don't blame capitalism, I blame human greed.
AI can't solve problems. This should be abundantly clear by now from the number of laughable and even dangerous "solutions" it gives while stealing content, destroying privacy, and sucking up tons of power to do so. Just ban AI.
You really need to specify what you mean by "AI". AI has been used in tons of applications for decades. Do you mean LLMs? Because not all AI is LLMs.
Just take some time to look up the benefits of AI and what it is being used to solve. It's easy to focus on how corporations are abusing the technology for profit, but it's a bland weak perspective to think that AI can't solve problems.
Ah yes. Let’s ban AI so the cartels take over the market for AI. What a great plan.
I choose to privately self-host open source AI models and stuff on Linux. It's almost like technology is a tool and corps are the ones fucking things up. Hmmm, imagine that.
Agreed
GPT4ALL ftw
It's so fun to play with offline AI. It doesn't have the creepy underpinnings of knowing art and journalism as well as musings from social media was blatantly stolen from the internet and sold as a service for profit.
Edit: I hate theft and if you think theft is ok for training llms go ahead and dislike this comment. I don't feel bad about what I said, local offline AI is just better because it doesn't work on the premise of backroom deals and blatant theft. I will never use an AI like DALL.E when there is a talented artist trying to put food on the table with a skill they honed for years. If you condone stealing you are a cheap, heartless, coward.
I hate to break it to you, but if you're running an LLM based on (for example) Llama the training data (corpus) that went into it was still large parts of the Internet.
The fact that you're running the prompts locally doesn't change the fact that it was still trained on data that could be considered protected under copyright law.
It's going to be interesting to see how the law shakes out on this one, because an artist going to an art museum and doing studies of those works (and let's say it's a contemporary art museum where the works wouldn't be in the public domain) for educational purposes is likely fair use - and possibly encouraged to help artists develop their talents. Musicians practicing (or even performing) other artists' songs is expected during their development. Consider some high school band practicing in a garage, playing some song to improve their skills.
I know the big difference is that it's people training vs a machine/LLM training, but that seems to come down to not so much a copyright issue (which it is in an immediate sense) as a "should an algorithm be entitled to the same protections as a person? If not, what if real AI (not just an LLM) is developed? Should those entities be entitled to personhood?"
I'm on his side, I don't get the dislike. Maybe he likes massive corporations stealing people's data putting artist and journalist out of work.
I think it's important to note that Linux can be a way to avoid AI, but doesn't have to be. If you flip the headline around it almost implies that people who do want AI would be missing out by using Linux, but that's not true at all: instead, the reality is that Linux is still better for them, too, because you could install all the same kind of functionality if you wanted, but it would be wholly under your control, not Microsoft's.
Self hosted AI seems like an intriguing option for those capable of running it. Naturally this will always be more complex than paying someone else to host it for you but it seems like that's that only way if you care about privacy
Check out Jan AI. It's open source and extremely easy to install and run. I run it locally on a 2017 laptop without a dedicated GPU and it works, just takes longer to generate responses compared to something like ChatGPT.
Beautifully stated. Owning the AI personally as I own my personal computer if not more is the key.
That sounds very cool. I'm totally ignorant of the hardware requirements. What sort of minimum setup would such an install take?
It really depends on what model you want to run and how much training is bundled with it. You can pretty much run any model if you have enough disk space but of course GPU + VRAM is preferred for a ChatGPT like fast response. Otherwise, running on an older CPU and RAM is going to be noticeably slower, especially with complex models with a lot of training data to trawl through.
There are some pretty lite models out there but the responses will be more barebones and probably seem 'less informed'.
Give GPT4All a try for your first time. It makes install, configuration and usage point-and-click while being fairly straight forward. For the presented/featured models, it presents a small summary and VRAM recommended, though there are many, many other models available from inside the UI.
Will my dell latitude from 2006 work?