1w ago

Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity

Do you remember the recent post that self-assessing any effect is hard? Here is a comparison between self-assesment and measurements.

Surprisingly, we find that when developers use AI tools, they take 19% longer than without—AI makes them slower.

1w ago

Study: Experienced developers thought they were 20% faster with AI tools, but they were actually 19% slower

1w ago

Measuring the Impact of AI on Experienced Open-Source Developer Productivity

11 comments

Actually LMAO'd lol
You know that feeling when you just knew something for years and it feels so fucking funny and awesome to actually see that reflected in studies? Yeah.
- I guess that someday, somebody will find out and report that in nontrivial projects involving more than one person, it does not help to go faster if documentation is skipped altogether. 😂

Not me snarkily sharing this report in work chat. 🤣
- I honestly don't believe it's snarky. I think a lot of us have had enough of this corporate AI hype bullshit
  
  I’m right there for sure. Sadly, a whole lot of the people I work with are drinking the AI kool-aid hard.

Surprisingly, we find that when developers use AI tools, they take 19% longer than without—AI makes them slower.
Who is surprised, though?
- Not surprised by this at all, really; but I wonder if the code is of higher quality than without AI?

How reliable is this study? Is it peer-reviewed?
- Looks like not officially published yet with a date and journal, aka a pre-print.

11 comments