Microsoft has pulled back on over a gigawatt of planned data center capacity, suggesting that they do not think there is a growth future in generative AI
Power Cut
Cancelling new data centers because deep seek has shown a more efficient path isn't proof that AI is dead as the author claims.
Fiber buildouts were cancelled back in 2000 because multimode made existing fiber more efficient. The Internet investment bubble popped. That didn't mean the Internet was dead.
yeah, genai as a technology and field of study may not disappear. genai as an overinflated product marketed as the be all end all that would solve all of humanity's problems may. the bubble can't burst soon enough
Exactly. It's not as if this tech is going in the dumpster, but all of these companies basing their multi-trillion-dollar market cap on it are in for a rude awakening. Kinda like how the 2008 housing market crash didn't mean that people no longer owned homes, but we all felt the effects of it.
Historically, the field of AI research has gone through boom and bust cycles. The first boom was during the Vietnam War with DARPA dumping money into it. As opposition to the Vietnam War grew, DARPA funding dried up, and the field went into hibernation with only minor advancement for decades. Then the tech giant monopolies saw an opportunity for a new bubble.
It'd be nice if it could be funded at a more steady, sustainable level, but apparently capitalism can't do that.
Sometimes the hype bubble bursts and then the products eventually grows to be even larger than the hype. But you never know how connected hype actually is to any realistic timeline. Hype can pop like a cherry tree flowering on the first sunny day of spring, thinking summer has arrived, but then get drenched by another few weeks of rain. And as stupid as that cherry tree is, summer will eventually arrive.
I'm gonna disagree - it's not like DeepSeek uncovered some upper limit to how much compute you can throw at the problem. More efficient hardware use should be amazing for AI since it allows you to scale even further.
This means that MS isn't expecting these data centers to generate enough revenue to be profitable, and they're not willing to bet on further advancements that might make them profitable. In other words, MS doesn't have a positive outlook for AI.
Exactly. If AI were to scale like the people at OpenAI hoped, they would be celebrating like crazy because their scaling goal was literally infinity. Like seriously the plan that openai had a year ago was to scale their AI compute to be the biggest energy consumer in the world with many dedicated nuclear power plants just for their data centers. That means if they dont grab onto any and every opportunity for more energy, they have lost faith in their original plan.
More efficient hardware use should be amazing for AI since it allows you to scale even further.
If you can achieve scaling with software, you can delay current plans for expensive hardware. If a new driver came out that gave Nvidia 5090 performance to games with gtx1080 equivalent hardware would you still buy a new video card this year?
When all the Telcos scaled back on building fiber in 2000, that was because they didn't have a positive outlook for the Internet?
Or when video game companies went bankrupt in the 1980's, it was because video games were over as entertainment?
There's a huge leap between not spending billions on new data centers ( which are used for more than just AI), and claiming that's the reason AI is over.
Fiber buildouts were cancelled back in 2000 because multimode made existing fiber more efficient.
Sorry but that makes no sense in multiple ways.
You must mean something else entirely.
I think they conflated multimode with DWDM.
Sorry I meant wdm. Multimode was for home installs.
This is a good point. It’s never sat right with me that LLMs require such overwhelming resources and cannot be optimized. It’s possible that innovation has been too fast to worry about optimization yet, but all this BS about building new power plants and chip foundries for trillions of dollars and whatnot just seems mad.
Yeah you echo my thoughts actually. That efficiency could be found in multiple areas, including deepseek. That perhaps too that some other political things may be a bit more uncertain.
AI is a tool, like a hammer. Useful when used for its purpose. Unfortunately every tech company under the sun is using it for the wrong fucking thing. I don't need AI in my operating system or my browser or my search engine. Just let it work on protein folding, chemical synthesis and other more useful applications. Honestly can't wait for the AI hype to calm the fuck down.
You forgot mass surveillance. It's great at that.
Preach it. I have been so sick of AI hype and rolling my eyes any time a business advertises it, and in some cases moving on. I don't care about your glorified chat bot or search engine.
AI is the buzzword for a search engine that actually fucking works, something we used to have that gradually got enshittified out of existence
It'll balance out. I'm old enough to remember many web tech being this way from flash, to Bluetooth to Cloud.
It works pretty well as research/learn tool at my job.. I learned a lot very fast using AI as a tool in my browser.
There's been talk for a while that "AI" has reached a point where merely scaling up compute power is yielding diminishing returns; perhaps Microsoft agrees with that assessment.
My guess is that, given Lemmy’s software developer demographic, I’m not the only person here who is close to this space and these players.
From what I’m seeing in my day to day work, MS is still aggressively dedicated to AI internally.
That's compatible with a lack of faith in profitable growth opportunity.
So far they have gone big with what I'd characterize as more evolutionary enhancements to tech. While that may find some acceptance, it's not worth quite enough to pay off the capital investment in this generation of compute. If they overinvest and hope to eventually recoup by not upgrading, they are at severe risk of being superseded by another company that saved some expenditure to have a more modest, but more up to date compute infrastructure.
Another possibility is that they predicted a huge boom of a other companies spending on Azure hosting for AI stuff, and they are predicting those companies won't have the growth either.
I think deepseek shook them enough to realize what should have been obvious for a while... Brute force doesn't beat new techniques, and spending the most might not be the safest bet
There's a ton of new techniques being developed all the time to do things more efficiently, and if you don't need a crazy context window, in many use cases you can get away with much smaller models that don't need massive datacenters
Because investors expect it, whether it generates profit or not. I guess we will see how it changes workflows, or whether people continue to do things like they always have.
Why would a company or government use Azure or windows if MS is compromising it with ai?
Pick a lane
Same. Big tech is still whole hog on Generative AI
Context is king which is why even the biggest models get tied in knots when I try them on my niche coding problems. I've been playing a bit with NotebookLM which promises to be interesting with enough reference material but unfortunately when I tried to add the Vulcan specs it complained it couldn't accept them (copyright maybe?).
We have recently been given clearance to use the Gemini Pro tools with Google office at work. While we are still not using them for code generation I have found the transcription and meeting summary tools very useful and certainly a time saver.
Hmm, not meaning to get my conspiracy hat on here but do we think this could relate to the fact that Microsoft now has a quantum computing chip that they can hype to their investors to show they have the next big thing in the bag?
AI has served its purpose and is no longer strategically necessary?
Since they are only spending investors money it doesn't matter if they burn billions on leading the industry down the wrong path and now they can let it rot on the vine and rake in the next round of funding while the competition scrambles to catch up.
Literally IBM a decade ago. AI->Quantum
How would that be a conspiracy. If the AI bubble bursts eventually, I’m sure Microsoft won’t want to be among the last ones to leave.
„Microsoft stopped building AI data center infrastructure, therefore Microsoft signals that there’s not enough demand” is a valid point in itself but not enough to merit a blog post that’s this long.
I’m getting an impression that minor fame and success went into Ed Zitron’s head because he now brags about those word counts and other pretentious shit on BlueSky constantly.
Really? That's disappointing.
I was hoping for more credible people to be pointing out the wank that is generative AI.
I don't buy that. The article covers a lot more than the cancellation of data center leases.
It also talks about Stargate, SoftBank, and a lot of other related elements that point to the original premise as the correct one - M$ is aware they're not going to get the bike for Christmas.
Ed Zitron is credible but he’s trying a little bit too much for his own good. My guess is loads of people bought into the hype and are now holding the bags awkwardly and we’re left with smug assholes pointing that out. Takes one to know one ;)
Yeah I mean, when has Microsoft of all companies ever been wring about the future of technology.......
Hmmm let me just bring this on Internet explorer on my windows phone.
There’s no need for huge, expensive datacenters when we can run everything on our own devices. SLMs and local AI is the future.
This feels kinda far fetched. It's like saying "well, we won't need cars, because we'll all just have jetpacks that we use to get around." I totally agree that eventually a useful model will run on a phone. I disagree it's going to be soon enough to matter to this discussion. To give you some ideas, DeepSeek is a recent model. It's 671B parameters. Devices like phones are running 7-14B models. So, eventually what you say will be feasible, but we have a ways to go.
The difference is that we’ll just be running small, specialized, on-demand models instead of huge, resource-heavy, all-purpose models. It’s already being done. Just look at how Google and Apple are approaching AI on mobile devices. You don’t need a lot of power for that, just plenty of storage.
It's not like Microsoft has their finger on the pulse of technology advancement, they only got involved with AI to seem relevant, and now it's not worth doing anymore.
I was thinking this. Microsoft got some participation on OpenAI and has been paying them with cheap credits to run on their data centers. I guess they’re starting to worry that once the house of cards collapse, they’ll be the ones to pick up the pieces for any over-investment.
Maybe thanks to tariffs the importation of components made overseas will become cost prohibitive vs any expected potential gains from further development of LLM/AI. Or, perhaps in addition, an expected economic downturn has caused them to re-evaluate large investments in the immediate future. Or maybe they think AI is dumb.
I had a feeling this was coming.
Poor ELIZA, she's going to have to start hitting the corner's again.
WYEA? 🌝🤡
I see it more like they are confident to get running LLMs less resource intensive 🤔
