ExLisper Site
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
sanitation@lemmy.todayBanned from community to Technology@lemmy.worldEnglish · 5 months ago

Advanced AI models suffer a near-total collapse on classic psychology test as cognitive demands increase

www.psypost.org

external-link
message-square
57
link
fedilink
285
external-link

Advanced AI models suffer a near-total collapse on classic psychology test as cognitive demands increase

www.psypost.org

sanitation@lemmy.todayBanned from community to Technology@lemmy.worldEnglish · 5 months ago
message-square
57
link
fedilink
When tested with a classic psychological assessment, advanced AI models experienced a total breakdown in focus. A new PNAS Nexus study suggests these systems lack the human-like executive control necessary to override automatic responses and maintain complex goals.
  • ryannathans@aussie.zone
    link
    fedilink
    English
    arrow-up
    7
    ·
    5 months ago

    These models tested are so old they’re from the era where they couldn’t pass a math test or count letters in words

    • khornechips@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      17
      ·
      5 months ago

      So… last week then?

    • scratchee@feddit.uk
      link
      fedilink
      English
      arrow-up
      8
      ·
      5 months ago

      Afaik that is handled through tool use in modern models (ie they didn’t learn to do maths, they learnt to use a calculator), assuming that’s true and I haven’t missed some advance, their conclusions are likely still relevant

      Edit: though the article does seem to discard the chain of thought techniques a little readily, feels like they could come close to fitting the role of executive control, but perhaps that’s just the article lacking detail from the original work.

      • Monument@piefed.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        5 months ago

        My high school math teachers would be so disappointed in them.

        • scratchee@feddit.uk
          link
          fedilink
          English
          arrow-up
          4
          ·
          5 months ago

          If I could wire a calculator into my brain I would have cheated on all the maths tests tbf

          • toynbee@piefed.social
            link
            fedilink
            English
            arrow-up
            2
            ·
            5 months ago

            This was surprisingly hard to find in an easily shareable form.

      • MangoCats@feddit.itBanned
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        10 days ago

        Removed by mod

Technology@lemmy.world

technology@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@lemmy.world

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


  • @L4s@lemmy.world
  • @autotldr@lemmings.world
  • @PipedLinkBot@feddit.rocks
  • @wikibot@lemmy.world
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 3.57K users / day
  • 8.29K users / week
  • 13.9K users / month
  • 26.8K users / 6 months
  • 1 local subscriber
  • 89.9K subscribers
  • 9.95K Posts
  • 229K Comments
  • Modlog
  • mods:
  • L3s@lemmy.world
  • enu@lemmy.world
  • Technopagan@lemmy.world
  • L4sBot@lemmy.worldB
  • BE: 0.19.21
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org