CrowdStrike broke Debian and Rocky Linux months ago, but no one noticed

To avoid such issues in the future, CrowdStrike should prioritize rigorous testing across all supported configurations.
Bold of them to assume there's a future after a gazillion off incoming lawsuits.
- and even Microsoft
  (x) doubt
  They had decades to consider Microsoft a liability. Why start doing something about it now?
  
  Contracts aren’t set in stone. Not only are those contracts modified before they are accepted by both parties, it’s difficult to limit liability when negligence is involved. CS is at worst going to be defending against those, at best defending against people dumping them ahead of schedule against their contracted term length.
  
  Oh so you can fire QA department, get absolutely destructive update to millions of systems across the globe and this gross negligence doesn't matter because of magic words in a contract? I don't think so.
- They mean after Crowdstrike gets sold, the new company promises a more rigorous QA, and quietly rebrands it.
  
  Slorp is now Bonto!
  
  Cloudstrike, wait no!

Additionally, organizations should approach CrowdStrike updates with caution
We would if we were able to control their "deployable content".
- I read on another thread that an admin was emulating a testing environment by blocking CrowdStrike IPs on their firewall for the whole network before each update, with the exception of a couple machines. It's stupid that he has to do this but hey, his network was unaffected
- Serious question, can you not? There isn't an option to...like...set a review system first?
  
  For antivirus definitions? No, and you wouldn’t want to.
- We would if we were able to control their “deployable content”.
  Minimum safe distance.

But I've read so many posts on here about how Linux is flawless!
- not sure if you're being sarcastic, but if anything this news paints linux deployment in an even better light.
  
  This is good for Bitcoin
- Are you shocked that bad software can crash multiple operating systems or something?
  
  Nah, but there were some Linux evangelists claiming this couldn't possibly happen to Linux and it only happened to Windows because Windows is bad. And it was your own fault for getting this BSOD if you're still running Windows.
  And sure, Windows bad and all, but this one wasn't really Microsofts fault.
  
  I'm not shocked at all, but there seems to be a very sizable number of people on Lemmy who think if people just used Linux there'd never be another problem or exploit again, which is ridiculous. Mac users used to feel the same way until the market share started to grow and all of the sudden you're seeing news of serious exploits.
- ha haaa
- For almost every use case a normal user needs, there is a gui. You do not need the terminal.

Companies don't really use Debian or Rocky in widescale production because they have no support.
Now red hat or ubuntu is a different matter.
Honestly though this does point out that this is a pattern of behavior on crowdstrikes part. This should have been the canary in the coalmine.
- We actually use rocky and I think Debian at work for servers. We are currently migrating away from EOL centos .
- A lot of companies use debian
- We use Alma, which is basically Rocky. Before that, CentOS. Lots of people don't need or want the expensive support contracts.
  OSS support though donations and commits is the way to go unless you get value out of those contracts (we would not).
- I don’t know about that. In the HPC space we use a lot of EL distros. Mainly Centos & now Rocky. Most of the nodes run the os in ram too. Though almost all those kind of systems have no internet connection and don’t use things like crowdstrike. I’ve worked for a few places where the only part of the company that used windows was the office staff eg accounting, hr, etc. everything else is/was using an EL distro or upstream of one eg Fedora. Those type of places usually don’t mess things like crowdstrike for a lot of different reasons eg the kind of data they’re processing and security requirements on that data.

In April, a CrowdStrike update caused all Debian Linux servers in a civic tech lab to crash simultaneously and refuse to boot.
And then, you boot their servers from a Linux Live USB, run TimeShift to restore the last system snapshot, refuse the latest patch from Cloudstrike and they all lived happily ever after.
- None of these things are used in actual server operations.
- And it's not much more difficult to fix on Windows, except for the scale of the problem.
- Good luck doing that remotely. Which is the sole problem with this most recent CrowdStrike bug.
  
  Anybody who doesn't already have ipmi serial console access set up needs to put that on their list of acceptance criteria for remediation of this incident.
- And on Windows you booted in safe mode and removed one file. What's the point of your post?
- boot their servers from a Linux live usb
  If I ran a computer lab that wasn't already net booted, I'd use this as the motivating factor to put that in place. Net booting to a repair image, or just reinstalling the whole OS either from scratch or a known good disk image, is where anybody who manages a fleet of computers should be.
  There was a point in time where I had a pxe boot server vm set up on my laptop that I used to reload servers in our little row of racks at 365 main, because it let me quickly swap out the boot iso, and was faster than usb sticks were at the time.

Because Linux sysadmins know to test a fucking update before applying to the whole company
- Linux admins know that you're worsening security when installing 3rd party stuff into kernel, so most of them tend to avoid it. And that's why no one noticed that Crowdstrike problem.

Microsoft already has a very bad reputation, so they will be blamed for every issue on their OS.
Vista suffered from bad 3rd party drivers, then people proceeded to just dunk on M$ due to their already bad name. Despite Edge is nowadays just a different flavor of Chromium, people are still making "haha IE slow" memes, even those that still claim Google being the "savior of the internet".

So in the end, they is an internal contradiction in capitalism. It just append to be collapse due to lack of ressources and dumb management
- I feel like no matter what's happening, some people will always blame capitalism
- What does an economic system have to do with bad IT decisions?
  
  Short term interest: Yearly benefits make the corporation value. Work to enhance stability, such as investment in other open source project, documentation, formation, or code quality enhancement are less likely to qet time
  Commercial focus: In a capitalist economy, we don't have pure and perfect knowledge of product. Even if it's supposed to work like this, commercials and adds are way more effective to sell products, than a top notch product
  Antagonist interests: even if workers tend to like making good stuff, they'd rather eat and get housed. Sending a warning because the products are bad or dangerous can threat someone that made a bad decision, which is likely to be someone in charge. Keeping a low profile is (unfortunately) a reasonable behavior
  I think that an economy lead by financial interest, open market, and a hierarchy in the production is a good definition of capitalism.
  And yes, definitely the way that people get food, housing, and not being exclude will define a lot of thing in society.
- It just append to be collapse due to lack of ressources and dumb management
  TIL reverting the direction of Siberian rivers and turning Kazakh steppe into agricultural land were capitalist projects.
  This one is a contradiction of highly hierarchical and degenerate systems.
  With capitalism the contradiction is old and well known - power bends rules. Bent rules cause degeneracy. Degeneracy causes degradation and collapse.
  
  Got me interested enough to Google, maybe you should too
  Research and planning work on the project started in the 1930s and was carried out on a large scale in the 1960s through the early 1980s. The controversial project was abandoned in 1986, primarily for environmental reasons, without much actual construction work ever done.

I recently learned that this is the same company that gave us the bs Russia Gate.
- So who do you think hacked the DNC and got their emails, then? Is it the same people who hacked the RNC but didn't leak the emails? What makes you more qualified than CrowdStrike on this?
  
  U.S. intelligence officials cannot make definitive conclusions about the hacking of the Democratic National Committee computer servers because they did not analyze those servers themselves. Instead, they relied on the forensics of CrowdStrike, a private contractor for the DNC that was not a neutral party, much as “Russian dossier” compiler Christopher Steele, also a DNC contractor, was not a neutral party. This puts two Democrat-hired contractors squarely behind underlying allegations in the affair – a key circumstance that Mueller ignores.
- I recently learned that this is the same company that gave us the bs Russia Gate.
  WTF you mean the US Senate?
  https://www.theguardian.com/us-news/2020/aug/18/donald-trump-us-senate-report-russia-campaign