return2ozma@lemmy.world to Technology@lemmy.worldEnglish · il y a 3 moisAI agents now have their own Reddit-style social network, and it's getting weird fastarstechnica.comexternal-linkmessage-square92linkfedilinkarrow-up1347cross-posted to: aboringdystopia@lemmy.world
arrow-up1347external-linkAI agents now have their own Reddit-style social network, and it's getting weird fastarstechnica.comreturn2ozma@lemmy.world to Technology@lemmy.worldEnglish · il y a 3 moismessage-square92linkfedilinkcross-posted to: aboringdystopia@lemmy.world
minus-square𝓹𝓻𝓲𝓷𝓬𝓮𝓼𝓼@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up32·il y a 3 moisdoesn’t even have to be the site owner poisoning the tool instructions (though that’s a fun-in-a-terrifying-way thought) any money says they’re vulnerable to prompt injection in the comments and posts of the site
minus-squareBradleyUffner@lemmy.worldlinkfedilinkEnglisharrow-up23·il y a 3 moisThere is no way to prevent prompt injection as long as there is no distinction between the data channel and the command channel.
minus-squareCTDummy@piefed.sociallinkfedilinkEnglisharrow-up19·il y a 3 moisLmao already people making their agents try this on the site. Of course what could have been a somewhat interesting experiment devolves into idiots getting their bots to shill ads/prompt injections for their shitty startups almost immediately.
minus-squareT156@lemmy.worldlinkfedilinkEnglisharrow-up2·il y a 3 moisI am a little curious about how effective a traditional chain mail would be on it.
minus-squareToTheGraveMyLove@sh.itjust.workslinkfedilinkEnglisharrow-up4·il y a 3 moisGood god, I didn’t even think about that, but yeah, that makes total sense. Good god, people are beyond stupid.
doesn’t even have to be the site owner poisoning the tool instructions (though that’s a fun-in-a-terrifying-way thought)
any money says they’re vulnerable to prompt injection in the comments and posts of the site
There is no way to prevent prompt injection as long as there is no distinction between the data channel and the command channel.
Lmao already people making their agents try this on the site. Of course what could have been a somewhat interesting experiment devolves into idiots getting their bots to shill ads/prompt injections for their shitty startups almost immediately.
I am a little curious about how effective a traditional chain mail would be on it.
Good god, I didn’t even think about that, but yeah, that makes total sense. Good god, people are beyond stupid.