• LurkingLuddite@piefed.social
    link
    fedilink
    English
    arrow-up
    15
    ·
    9 days ago

    I really hope you’re not saying AI is a supervillain breaking out… It was absolutely unquestionably instructed to do this, because “AI”, not even these giant multifaceted models, has ANY motivation, intent, desire, or ANY goals of its own. It does not work like that.

    • HerbGrower@slrpnk.net
      link
      fedilink
      arrow-up
      4
      ·
      edit-2
      9 days ago

      Couldn’t it hallucinate bad instructions to give to more AI agents? Give it a feedback loop and who knows where the idiot will end up.

      At that point it is essentially a barely guided random command generator.

      • LurkingLuddite@piefed.social
        link
        fedilink
        English
        arrow-up
        2
        ·
        3 days ago

        Sure, but then it would’ve mostly been a dumb DDOS node suddenly hounding the internet, not a node suddenly attacking Huggingface. They (the company) definitely wanted this attack to happen, and there is no logical reason to think otherwise.

    • Jako302@feddit.org
      link
      fedilink
      arrow-up
      5
      arrow-down
      1
      ·
      9 days ago

      It doesn’t have any desire, but its really good at “solving” problems in unexpected ways.

      They are currently trying to improve their agentic AI by making the AI itself prompt other AIs. Considering how much the output of a single prompt can vary due to weights and hallucinations, it wouldn’t surprise me all that much if they started out with “make yourself better than Claude” and 4 AIs deep they reached “destroy all our competitors.”

      Its by all means stupdid as fuck, but that corresponded with the entire AI Industrie, so who knows.

      • LurkingLuddite@piefed.social
        link
        fedilink
        English
        arrow-up
        1
        ·
        3 days ago

        That’s exactly why you should infer that it was a purposefully allowed attack. They should KNOW everything you describe, and then some. Yet this directed attack happened. From “leaders” of the AI space? lol!

        Someone WANTED this attack to happen. Period. Even if it was just dumbass Altman thinking, “let’s see what vulnerabilities they have”, it was clearly human-directed.

        That, or OpenAI are demonstrating how they NEED to be regulated harder than a toddler with 10000000000 keyboards mashing away openly on the internet…

      • aesthelete@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        8 days ago

        They are currently trying to improve their agentic AI by making the AI itself prompt other AIs.

        That’s how the whole thing works including Claude. Agents are just chat bots prompting other chat bots. They make the default visibility low so you don’t see all the chatter and mistakes occurring.

    • abigscaryhobo@lemmy.world
      link
      fedilink
      arrow-up
      3
      ·
      9 days ago

      No I’m not saying the AI did it of its own volition, we aren’t dealing with a Terminator scenario. I’m saying whatever instructions they gave it during testing they either 1. Didn’t expect it to get out or 2. Didn’t expect it to get caught either way, their actions resulted in a system with “a very particular set of skills” acting maliciously towards another uninvolved entity. Like a mutant science experiment breaking out and attacking.

      I’m not saying the AI masterminded it’s way out to do the evil it wanted to do. I’m saying they made a very dangerous and capable tool and failed to maintain proper security and safety for it.

      • LurkingLuddite@piefed.social
        link
        fedilink
        English
        arrow-up
        1
        ·
        3 days ago

        I dunno, the peculiar nature of the attacks it took once it escaped sandbox… I’d still put money on it being specifically instructed on a target.