Eight Myths on Software Engineering and GenAI

(queue.acm.org)

78 points | by tchalla 3 hours ago ago

36 comments

  • a_bonobo an hour ago

    >On my visits to the Bay Area, I would ask AI researchers or interns why they are doing their current research or projects, when in a year or three agentic LLMs could probably do them;

    This is such a weird point to make that doesn't become correct just because everyone makes it, all the time. Why clean the ocean if some magic future tech will clean them? Why save the world now if some benevolent AI is 'just around the corner' and will do it for us? And people have been making this point for years now, and it's not like my job got any easier. I just got more AI.

    https://www.poetryfoundation.org/poems/51294/waiting-for-the...

    And I say that as someone who uses Claude Code in complex environments almost hourly; I, as the human, still have to do the thinking as Claude still 'can't jump' [1] and I have seen no evidence that they (or similar AI, any time soon) will 'jump' like a human brain does.

    [1] https://www.tomzahavy.com/files/llms-cant-jump.pdf

    • decimalenough an hour ago

      I think you meant to post this in response to https://news.ycombinator.com/item?id=49174900?

    • fhub an hour ago

      > I, as the human, still have to do the thinking as Claude still 'can't jump'

      I still have to do quite a bit of thinking but the amount of of thinking I do per task is trending down. I agree LLMs are not good at abduction but very few humans are either and very few jobs/tasks require it. I can't talk for researchers jobs though. But perhaps fewer researchers would be desired by these labs (not none).

      • jihadjihad 28 minutes ago

        > I agree LLMs are not good at abduction but very few humans are either

        I, too, am glad that few humans seem good at abduction.

    • guybedo an hour ago

      although, if i'm out of tokens and have to wait a full day, i won't bother doing some things manually because the day i'll spend doing something won't take more than 1 hour the next day when tokens are available again.

    • DrewADesign 40 minutes ago

      Same reason some think preserving the environment is pointless because the believers will ascend to heaven, either way. It’s a religion. It’s dogmatic nihilism.

    • paul7986 20 minutes ago

      By trade I'm a UX Researcher/Designer who designs in code (HTML/CSS) and have done so since 2009. Recently I vibe coded an entire python app with a database and each time I didnt know what to do I would just feed screenshots to Gemini or Codex for guidance (i think i could share my screen with Codex and it can guide me via a voice conversation). I know I could follow up and build a companion iPhone and Android app using these tools.

      Overall, I'd like to understand those who have a positive outlook on design and software engineering as a career. Where do you see the opportunity where I just see a bleak one where anyone can do this stuff by typing or talking to AI? Myself, after 17 years in the field I am begrudingly back in school for a new medical career. As well, anytime an IT recruiter reaches out I am getting responses back only after under-cutting the hourly rate I use to demand and what others probably are still trying to get. And with it feels even bleaker as it becomes a race to the bottom!

    • esafak an hour ago

      Also, if you believe your well-paying job is eventually going to be automated you would be prudent to bank the money while you prepare for the future.

  • kylecazar 2 hours ago

    I don't understand Myth 1 (Developers Spend Most of Their Time Writing Code).

    They quote a study in which developers report to spend 11-14% of their day coding. The rest is stuff like solution design and meetings. The insinuation is that AI can at most automate 14% of your day.

    The problem with this argument is that once you have code, some (not all) of the precursors to code go away.

    • unknownfuture an hour ago

      Okay.

      Show me the evidence that AI has an impact on productivity when doing design work. Or reducing meeting load.

      My own experience is that AI doesn't tighten the design cycle, and in fact might extend it by encouraging gold plating.

      • simonw an hour ago

        What kind of shape of evidence would you find convincing?

        • unknownfuture an hour ago

          Self-reported or observational data capturing time spent for categories of task ala every other similar study in this space?

          This isn't exactly novel territory, here, Simon. Let's not pretend I'm asking for something strange, unprecedented, or unreasonable.

        • bluefirebrand an hour ago

          People working fewer hours :)

          • kaashif 39 minutes ago

            Damn, looks like we have lower productivity than cavemen!

      • mountainriver an hour ago

        It does because you can now just steamroll features out the door and make everyone look bad that’s sitting around in meetings all day

    • mkozlows an hour ago

      Yeah, this seriously drives me nuts.

      That meeting that you spent an hour in to understand the requirements? You don't need that meeting if you're not writing the code. That sync up with the QA engineer you did to hand it off to them? Don't need that meeting if you're not writing the code. That half hour you spent installing vim extensions? Don't need 'em if you don't open vim anymore.

      There are engineers whose jobs go well beyond coding, of course. Staff engineers and principal engineers have had their jobs radically change because of AI, but not because it's writing all their code.

      But there are also a lot of engineers -- your standard mid-level engineer, or even senior engineers at a lot of orgs with title inflation -- whose job is almost entirely about delivering code, and who spend all day either writing code or engaging in scaffolding around code-writing activities. Let's not pretend that automating away that code writing is a 15% boost.

      • decimalenough an hour ago

        > That meeting that you spent an hour in to understand the requirements? You don't need that meeting if you're not writing the code.

        How are you going to prompt the LLM or validate its output if you don't understand the requirements?

    • deadbabe 30 minutes ago

      I don't know about others, but at work, the reason I only spend like 14% of my day coding is because I'm lazy, not because I'm actually doing other stuff.

    • SpicyLemonZest an hour ago

      If Claude told you to work on a task that you don't want to work on, or make a design choice that you think is wrong, would you do it? If not, then it can't really replace things like design or meetings. (Note that this is subtly but importantly different than the "vibecoding" model, where you just don't bother to supervise Claude's decisions.)

  • mkozlows an hour ago

    I feel like all you need to know about how seriously to take this is that they cite that ancient early-2025 METR study, and describe it in the text as "recently one even found..."

    • CompoundEyes 32 minutes ago

      I felt the same and why didn’t the authors look over METR’s recent material?

      https://metr.org/blog/2026-05-11-ai-usage-survey/

    • katzgrau 31 minutes ago

      Same thought - 80% through reading it occurred to me to check the citations. A few items from 2025 and most well before that.

      So much has changed since late 2025 one can’t really draw any conclusions from this.

      In fact, I’m guessing things will continue to move so fast that by the time one were to execute a survey of developers, many of the responses and findings are no longer relevant.

  • simonw 2 hours ago

    > We already know developers don’t actually spend most of their time writing code, with studies at Microsoft and elsewhere showing it’s closer to 14 percent.

    Anyone else finding they're spending more time writing code (or at least driving agents to write code) now?

    14% used to feel about right for me - I'd spend the rest of the time researching approaches and libraries, planning things out in issues, or sometimes just thinking really hard about problems I ran into.

    Now... I still do those things, but I'm doing many of them faster - and I'm often doing them while my coding agents are churning away on code.

    There's also this weird effect where the harder a problem is the more I can get done in parallel with it, because an agent might need to spend 20 minutes on it without my involvement.

    • geoduck14 an hour ago

      I used it to write SQL and make dashboards. Back in the day, I would spend a lot of time doing that, then I changed roles. I dipped my toe in it recently and used AI exclusively. I would send a prompt, see the output, decide if that is what I wanted or not. I kept my brain in "what-if mode" and I let the LLM handle the technical specs.

    • enraged_camel 2 hours ago

      Yeah. I spend most of my day driving agents to write code, verifying the results, orchestrating work streams, and so on. The rest of the time, a Fable agent is organizing work in Linear/Jira and making sure coworkers are getting their stuff done in a way that won’t conflict.

  • langs 17 minutes ago

    > Myth 2: Writing Code Is the Bottleneck

    Writing code is indeed the bottleneck for same resource constrained companies.

    Rapid code development creates more opportunities for trial and error, providing companies with more information for decision making, that previously might have been addressed by meetings.

    Of course, this might bring other problems, but it might not right to generally speaking that writing code is not a bottleneck.

  • lovecg 24 minutes ago

    > studies at Microsoft and elsewhere showing it’s closer to 14 percent

    This is a depressing stat. The real productivity gains come from leaving soul sucking big tech companies where nothing gets done with any sort of urgency.

    • afdbcreid a minute ago

      In my open source work I believe this is the same. I don't have numbers, but I'm sure the vast majority of my time isn't spent writing code. Of course, it depends on how you define "writing code".

  • LAC-Tech 3 minutes ago

    All very sensible points which I think all senior programmers who have used AI would largely to agree with.

    For those more junior - keep in mind that a lot of the maximalist rhetoric are from people either selling models, or the cottage industry of people selling you courses or tools to help you use the models. Try and keep in mind this is not a mature industry, it's an immature one, and it's prone to hype and fads.

  • osigurdson 2 hours ago

    It seems that this could have been expanded or contracted to any Fibonacci number of myths.

  • Supermancho 2 hours ago

    |--------|-------|------|------|-------|------|

    |Contract|Product|Design|Coding|Testing|Deploy|

    Writing Code Isn't the Bottleneck, until writing code is the bottleneck, until it's not again.

    • pstuart an hour ago

      Getting a usable PRD is often the bottleneck.

    • sublinear 2 hours ago

      You forgot to add "coordination" to that pipeline. That is easily far and away the biggest source of delays.

      That includes talking to vendors, meetings with every layer of stakeholder when just one person digs their heels, etc.

      That is truly the final frontier for "AI", and one that it will likely never cross. That would be when even the execs and upper management feel threatened by "AI". But, since they also delegate so much, you often see someone at the bottom of the totem pole in those meetings. This is why nobody is getting replaced by "AI". We really need to move this discussion away from the scifi stupidity already. There is no singularity or godlike AGI about to take over the world.

      I hate to use awful terms like "synergy" and "teamwork", but they do have a lot more substance and truth to them than any perceived threat from "AI".

  • physix 30 minutes ago

    >a “good” workday, engineers spent 18 percent of their time “coding” (not including bug fixing, testing, etc.)

    I must be a crap developer, because I probably spend twice as much time bugfixing and testing than "coding". (Both of which actually involve coding stuff, so I really don't like that distinction they make)

    This is stuff AI can be really good at, so brushing that part under the table distorts the picture.

    Having said that, I do agree with most of the myths they present.

  • armitron 22 minutes ago

    This reads like a critique of 2023 tooling published in 2026. Their Amdahl-style arithmetic (speed up a 14% slice, cap your gains at 14%) holds only if "AI" means autocomplete. Current frontier models do far more than that: research, code comprehension, review, test authoring, debugging, exploratory prototyping, ideation. That's most of the rest of the working day or "86%".

    The only point that still holds is that organizational policies and procedures that automate AI use and lower the barrier to entry are more efficient than leaving it up to each individual. Every other point they make is either stale or was never true to begin with.

  • TrustChain 2 hours ago

    The 14% coding time figure is one of those stats that sounds surprising until you actually track your own time. When I started building a coding agent with persistent state, I realized how some days are spent with minimal actual typing, most of it is design, reading code, debugging, problem solving, and context-switching.

    But I'd push back on one thing the article implies that AI is automatically a productivity win. It's not. Some days I've shipped two months of work in a few days with AI. Other days, like today, I've burned a whole day and gotten almost nothing done because the proper research was not done by me or multiple agents.

    The bottleneck for AI can be the human understanding of how to optimally use the tool. While the bottleneck for the human can be not maximizing multiple agents, or the input the user enters, then the retention of the output. If the user's input is lost, the output falters. If the user doesn't understand what the AI output is, there is going to be a problem eventually.

    The article touches on adoption barriers (Myth 7), but it doesn't really get into the ego piece. There's still a wave of experienced devs who either refuse to adopt AI, or use it quietly and don't share what they're doing. That slows the whole team's learning curve. At this point, I think it's pretty much understood that you should be using AI as a dev — not to replace your skills, but to accelerate them. That means still learning new languages, still writing code, still troubleshooting. The tools change, but the craft doesn't.

    I think the article is right that the real leverage is organizational, not individual. The teams that succeed with AI aren't the ones giving everyone a license — they're the ones rethinking how they review, test, and maintain code.

    What I'm still uncertain about is how to measure whether AI is actually making systems better, not just faster. Lines of code is clearly a bad metric, but I haven't seen a good alternative yet. What metrics are people actually using that feel meaningful?