NYC’s AI Chatbot Tells Businesses to Break the Law – The Markup
themarkup.org
The Microsoft-powered bot says bosses can take workers’ tips and that landlords can discriminate based on source of income

The Microsoft-powered bot says bosses can take workers’ tips and that landlords can discriminate based on source of income

  • Daxtron2@startrek.websiteEnglish
    0·
    9 months ago

    Yet another example of people fundamentally misunderstanding the proper use of LLMs and throwing them into production without any kind of sanity checks on the input and output. As someone who used to work for NYS as a software engineer, this is entirely unsurprising.

    • pdxfed@lemmy.worldEnglish
      0·
      9 months ago

      Work in HR. Have a very smart boss. Asked me about AI for recruiting, screening and other purposes. Told my boss, wait 5 years, we’ll see the catastrophic lawsuits and early adopters, then after 5 more there will be some plug and play usable solutions.

      Anyone eating up Big4 and startups own horseshit deserve what they get. They’ve fully demonstrated they don’t QC, and especially on critical, difficult to parse, contextual or changing info LLMs are incredibly immature.

      • P03 Locke@lemmy.dbzer0.comEnglish
        0·
        9 months ago

        LLMs are still good for the kind of flowery language you need in HR, but not for any sort of fact-based generation.

        Think of it as being creative, not logical.