• Aceticon@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    2
    ·
    12 分钟前

    AI Is Breaking the Entire Structure of Software That Powers the World

    On both sides even - both by better automating brute force hacking strategies AND by generating weakness-riddled code for network-facing software.

    What a great time to be alive!

  • shirro@aussie.zone
    link
    fedilink
    English
    arrow-up
    22
    ·
    3 小时前

    Don’t believe the hype.

    The truth is nobody ever has time to test things thoroughly. Proprietary software has to ship early due to unrealistic deadlines. Bad specs, client doesn’t know what the fuck they want. Open source dev doing weekend hobby coding suddenly getting pressured by billion dollar corps for features while trying to balance mental health, family, pay bills etc.

    So we take shortcuts. Ship code. Hope for the best. Better compiler warnings, linters and strict coding standards can help but only so much.

    LLMs let security researchers search for classes of bug that have been harder to find with other methods. Lots of low hanging fruit for them. Most of the vulnerablities are low impact and over hyped. Once they find them and they are fixed they aren’t going to find the same exact one again. The security stuff will get better. Unfortunately not so much careers.

  • ominous ocelot@leminal.space
    link
    fedilink
    English
    arrow-up
    10
    ·
    2 小时前

    It is already broken. Just the cracks come to light.

    Waiting for the reveal of the first serious bugs in AMDs and Intel’s management engines. Those tiny OS running on their own core next next to the user’s OS. Or the firmware of the network cards. This will be a fun day for users of older PCs without the chance to receive patches.

  • ArgentRaven@lemmy.world
    link
    fedilink
    English
    arrow-up
    41
    ·
    4 小时前

    IT has been cut to bare bones for a long time, now. Some VP made their cost cutting bonus 10 years ago. Their successor did the same. And their successor. THIS is the result. This is our culture. Make the rich richer now no matter who suffers later.

    I work in IT security and I’ve buried many colleagues and friends that died from over-stress. Usually their hearts give out. My best friend died last December. Not that rich C suite executive, though. Now there’s no one left to work late and fix all the problems. They’ve deputized whole divisions to the patching and vulnerability teams, just to stem the bleeding so the companies don’t end up in the news. But as soon as we fixed one, another comes up. I’m not speaking in abstract terms - that was literally my Wednesday. We can’t get ahead of it. A concentrated cyber attack by AI that doesn’t get tied, bored, or blocked will eventually succeed. Our legacy code running Java dependencies on Windows 95 isn’t getting replaced because it’s not in the budget.

    I just hope they don’t go for infrastructure.

  • eicker@lemmy.worldOP
    link
    fedilink
    English
    arrow-up
    81
    ·
    5 小时前

    AI isn’t breaking software by itself. It’s revealing just how much of the world runs on code held together by hope, legacy dependencies, and one exhausted maintainer. The exciting new feature is that attackers can now find those cracks for $200 while the security team is still waiting for budget approval.

    • Buffalox@lemmy.world
      link
      fedilink
      English
      arrow-up
      15
      ·
      3 小时前

      Yes it is, it is making programmers leave, and it is preventing new programmers from learning the basics of a project.
      My wife just told me she that Debian is losing some of it’s most experienced programmers, because code submissions are scanned by stupid LLM that as silly questions about the submissions that MUST be responded to.
      Disrupting maintenance absolutely breaks software, and AI is doing that all by itself.
      There aren’t even any $200 saved, as Debian is maintained by contributors.

        • boonhet@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          5
          ·
          3 小时前

          Eh if they can get the binaries off your server somehow, they don’t really need to decompile shit, they can just test their own instance of it

          • rogerdodger@lemmy.world
            link
            fedilink
            English
            arrow-up
            6
            ·
            3 小时前

            Decompiling is still usefull. It’s easier to find problems in the source code than blindly probing.

          • 2ndDegreeOWO@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            3 小时前

            A lot of places are using off-the-shelf software that attackers could just buy/download a copy of from the vendor.

    • jimmy90@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 小时前

      this is JAVA owned by ORACLE jesus fucking christ. AI is helping FIND BUGS because well paid well resourced humans make mistakes too.

      the luddite lemmings strike again

      • Bourff@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        2 小时前

        Refusing to acknowledge that AI helps every sociopathic script kiddie do real damage to the real world doesn’t help either.

  • Zeus@feddit.org
    link
    fedilink
    English
    arrow-up
    6
    ·
    4 小时前

    This is why you need strict quality control whenever you have AI making things.

    Cybersecurity experts need to thoroughly examine all the code and how the software works…or doesn’t work and help fix it

    Then you need ethical hackers to test the security and you need the cybersecurity experts to fix the problems the ethical hackers find.

    it’s boring, grueling work but if you don’t do it everything falls apart

    • TheMightyCat@ani.social
      link
      fedilink
      English
      arrow-up
      7
      ·
      4 小时前

      This is why you need strict quality control whenever you have AI making things.

      The article is about AI finding exploits.

      • mangofeet@fedia.io
        link
        fedilink
        arrow-up
        1
        ·
        3 小时前

        sure, but you can’t just patch shit Willy nilly without also breaking things.

        doing things correctly takes time and money, neither of which we have time for when we have the poor, defenseless, baby bird shareholder to take of!!

        • TheMightyCat@ani.social
          link
          fedilink
          English
          arrow-up
          1
          ·
          3 小时前

          I mean i agree that proper quality control and review is needed.

          Its just that the conclusion Zeus takes from this article is not really corroborated by the article.

      • FaceDeer@fedia.io
        link
        fedilink
        arrow-up
        1
        ·
        4 小时前

        It’s funny how the narrative until this point has been that AI is too crappy at coding to be useful.

        • Maestro@fedia.io
          link
          fedilink
          arrow-up
          8
          ·
          3 小时前

          In my experience, AI is really good at finding problems because of the large context window and speed. But it is really crappy at writing good code, because it can’t distinguished good code from bad. The way AI writes code is just to generate stuff and fix problems until all problems are gone. That is a terrible way to develop.