Scientists Train AI to Be Evil, Find They Can't Reverse It
futurism.com
How hard would it be to train an AI model to be secretly evil? As it turns out, according to Anthropic researchers, not very.

cross-posted from: https://lemmy.world/post/11178564

Scientists Train AI to Be Evil, Find They Can’t Reverse It::How hard would it be to train an AI model to be secretly evil? As it turns out, according to Anthropic researchers, not very.

  • skillissuer@discuss.tchncs.deOPEnglish
    0·
    11 months ago

    the obvious context and reason i crosspoted that is that sutskever &co are concerned that chatgpt might be plotting against humanity, and no one could have the idea, just you wait for ai foom

    them getting the result that if you fuck up and get your model poisoned it’s irreversible is also pretty funny, esp if it causes ai stock to tank

    • swlabr@awful.systemsEnglish
      0·
      11 months ago

      to be read in the low bit cadence of SF2 Guile “ai doom!”

      It’s not a huge surprise that these AI models that indiscriminately inhale a bunch of ill-gotten inputs are prone to poisoning. Fingers crossed that it makes the number go down!