Context: jest is a Javascript testing library, mocking is something you do in test in order not to use production services. AI understood both terms in a none programming context

        • Hazzard@lemm.ee
          link
          fedilink
          arrow-up
          4
          ·
          3 months ago

          Yeah, this is the problem with frankensteining two systems together. Giving an LLM a prompt, and giving it a module that can interpret images for it, leads to this.

          The image parser goes “a crossword, with the following hints”, when what the AI needs to do the job is an actual understanding of the grid. If one singular system understood both images and text, it could hypothetically understand the task well enough to fetch the information it needed from the image. But LLMs aren’t really an approach to any true “intelligence”, so they’ll forever be unable to do that as one piece.

        • stebo@lemmy.dbzer0.com
          link
          fedilink
          arrow-up
          2
          arrow-down
          1
          ·
          edit-2
          3 months ago

          Well tbf this isn’t what chatgpt is designed for. It can interpret images and give information/advice/whatever, but not solve puzzles crossword puzzles entirely.