Need to let loose a primal scream without collecting footnotes first? Have a sneer percolating in your system but not enough time/energy to make a whole post about it? Go forth and be mid: Welcome to the Stubsack, your first port of call for learning fresh Awful you’ll near-instantly regret.

Any awful.systems sub may be subsneered in this subthread, techtakes or no.

If your sneer seems higher quality than you thought, feel free to cut’n’paste it into its own post — there’s no quota for posting and the bar really isn’t that high.

The post Xitter web has spawned soo many “esoteric” right wing freaks, but there’s no appropriate sneer-space for them. I’m talking redscare-ish, reality challenged “culture critics” who write about everything but understand nothing. I’m talking about reply-guys who make the same 6 tweets about the same 3 subjects. They’re inescapable at this point, yet I don’t see them mocked (as much as they should be)

Like, there was one dude a while back who insisted that women couldn’t be surgeons because they didn’t believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I can’t escape them, I would love to sneer at them.

  • Steve@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    5 months ago

    We should neoligise “NASB” for our community as shorthand for “Not a sneer, but”

    • Soyweiser@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      New existential threat developed, we go all in on AGI economically, turns out to not be possible and then the world collapses due to infrastructure rot. I’ll email Yud.

      • V0ldek@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        Make it even funnier, AGI launches and then gets taken down because the only maintainer of xzutils left and now every time the AGI tries to run ./killallhumans it segfaults to death.

        • Soyweiser@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          5 months ago

          Somebody installed a crypto miner so deep into the kernel of the AGI that the self modification of the AGI cannot touch it, and it just crawls to a halt. And the cryptocurrency itself is one of those flash in the pan meme currencies that long since went to ~zero.

      • o7___o7@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        5 months ago

        In the vein of collapsing infrastructure, my condolences to anyone dealing with aftermath of Crowdstrike’s big ol fucky wucky. If I were a bad person looking for entertainment, I would seed a conspiracy theory about how today’s cockup is really the result of Rationalist sleeper agents launching a guerilla struggle to strangle the basilisk in its crib.

        Question for the experts: do you all suppose this will drive a new cycle of hype around thin clients and network booting?

        • froztbyte@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          5 months ago

          Question for the experts: do you all suppose this will drive a new cycle of hype around thin clients and network booting?

          I don’t think this alone would push towards that (any more than the last few years of “everything is a webapp!!!” have done), but I would love to see people try to hypewave this purely so we get rid of so much fucking fat js garbage

  • jax@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    5 months ago

    In the land down under, the ABC continues to feed us with golden tech takes: Australia might be snoozing through the AI ‘gold rush’

    “This is the largest gold rush in the history of capitalism and Australia is missing out,” said Artificial Intelligence professor Toby Walsh, from the University of New South Wales.

    It’s even bigger than the actual gold rush! Buy your pans now folks!

    One option Professor Van Den Hengel suggests is building our own Large Language Model like OpenAI’s ChatGPT from the ground up, rather than being content to import the tech for decades to come.

    lol, but also please god no

    “The only way to have a say in what happens globally in this critical space is to be an active participant,” he said.

    mate, I think that ship might have already sailed

    • maol@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      As the saying goes, the only people who make money in a gold rush are the people selling shovels. I guess this bloke is one of the people selling shovels.

    • o7___o7@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      5 months ago

      It’s my impression that Australia has also produced a disproportionate share of best takes on the subject. How come they are so far ahead of the rest of the world when it comes to dodging this grift?

      • blakestacey@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        Artificial Intelligence professor Toby Walsh

        Asking for a professor of genuine intelligence is just too much.

      • Architeuthis@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        5 months ago

        I mean, that was definitely a thing when I was at school, only it was mostly about teaching undergrads graph search algorithms and the least math possible in order to understand backpropagation.

        As an aside, weird that we don’t hear much about genetic algorithms anymore, but it’s probably just me.

    • self@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      the replies I can see in the archive are already a fucking disaster

      roko spewed the most nonsensical, fash-coded disapproval you could imagine:

      the map should reflect the territory, not the feelings

      that’s right roko, uh, maps don’t care about your feelings?

      oh god I clicked through to the rest of roko’s comments in that thread and it’s even worse, cw transphobia for anyone who peeks their head in

      • Sailor Sega Saturn@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        5 months ago

        I don’t want to hear that I’m irrational from Roko of all people haha.

        Dude sure spends a lot of energy on trans people and immigrants and wokeness for someone who thinks that climate change doesn’t matter because “by 2100 we will probably have disassembled Earth long with the rest of the solar system, and climate change will seem very quaint.”

        Also is his flirting with white supremacy new, or has he always been that fascist of a weirdo?

        • self@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          5 months ago

          Also is his flirting with white supremacy new, or has he always been that fascist of a weirdo?

          he’s always come off as deeply fascist to me, though it’s possible he’s gone even more mask-off with the white supremacy. I feel that roko’s personal style of saying the stupidest thing you’ve ever heard and claiming it’s brilliant has influenced the e/acc crowd a lot too, so maybe there’s some cross-pollination of ideas there.

          “by 2100 we will probably have disassembled Earth long with the rest of the solar system, and climate change will seem very quaint.”

          yes, roko, it’s pretty fucking obvious that climate change will seem quaint by 2100

          if it doesn’t fucking kill us way before then. that’s what makes it a fucking threat, roko, did your big ol mediocre brain miss that?

  • self@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    5 months ago

    Proton, who I use for mail and various other services, has gone against the wishes of the majority of their userbase as measured by their own survey and implemented an LLM writing assistant in protonmail, which is a real laugh given Proton’s main hook is its services are end-to-end encrypted

    (supposedly this piece of shit will run locally if you meet these incredibly high system requirements including a high end GPU or recent, high end Apple M chipset and a privacy-violating Chromium-based browser. otherwise it breaks e2e by sending your emails unencrypted to Proton’s servers, and they do a lot to try to talk over that fact)

    • froztbyte@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      Saw this in passing earlier and I just laughed

      Until indicated otherwise I’m going to presume it was some bizbro PM/PO/whatever pushing it because they really think it should be there “to be able to compete” (because of some laughably idiotic misunderstanding of their own value proposition and pitch)

      Tangent: while I mostly run my own servers and services I did a recent assay on who’s reasonable for service shit. Proton kept popping up massively recommended while some occasional critical mentions from folks in anarchist circles, etc - made me a bit 🤨 and want to dig in more, but also just their product offerings aren’t great. Others I poked into are fastmail and tuta - both seem a fair bit better. Might be worth a look

      • jax@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        Proton kept popping up massively recommended while some occasional critical mentions from folks in anarchist circles, etc - made me a bit 🤨 and want to dig in more,

        No surprise that folks in anarchist circles are skeptical of Proton ha. That said, I do know quite a few people in the email “industry” who are broadly skeptical of Proton’s general philosophy/approach to email security, and the way they market their service/offerings.

        Others I poked into are fastmail and tuta - both seem a fair bit better. Might be worth a look

        Fastmail has a great interface and user experience imo, significantly better than any other web client I’ve tried. That said, they’re not end-to-end encrypted, so they’re not really trying to fill the same niche as Proton/Tuta.

        From their website:

        Fastmail customers looking for end-to-end encryption can use PGP or s/mime in many popular 3rd party apps. We don’t offer end-to-end encryption in our own apps, as we don’t believe it provides a meaningful increase in security for most users…

        If you don’t trust the server, you can’t trust it to load uncompromised code, so you should be using a third party app to do end-to-end encryption, which we fully support. And if you really need end-to-end encryption, we highly recommend you don’t use email at all and use Signal, which was designed for this kind of use case.

        I honestly don’t know enough to separate the wheat from the chaff here (I can barely write functional python scripts lol - so please chime in if I’m completely off base), but this comes across to me as an understandable (and fairly honest) compromise, that is probably adequate for some threat models?

        Last time I used Tuta the user experience was pretty clunky, but afaik it is E2EE, so it’s probably a better direct alternative to Proton.

        • froztbyte@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          5 months ago

          re fastmail, david mentioned a thing I wasn’t aware of so they’re off the list now, more or less just going to forget they exist except as a counter-recommendation

          this comes across to me as an understandable (and fairly honest) compromise, that is probably adequate for some threat models?

          they’re sorta saying “yeah just use external GPG like before”

          albeit I will say their reasoning is a bit fucked in the head imo: that “if you can’t trust the server” shit applies equally for whether it’s serving you up the page elements to do message cryptography, or whether it’s serving you up a normal webmail client. I think I know/understand where they meant to go with it, but the wording they picked is quite shit

          I set up a tuta domain for a thing about a month ago. it could’ve been a bit smoother (esp. domain/dns state checks) but I didn’t find anything immediately jarringly bad - and I was even drunk at the time (which means my diy-able supergrump comes out about this sort of shit). will see how it goes over some longer use :)

    • ShakingMyHead@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      5 months ago

      Not to downplay what proton mail is doing, but they’re saying that you can run this locally with a 2 core, 4 thread CPU from 2017 (the i3 7100, which is a 7000 series processor), and a RTX 2060, a GPU that was never considered high end. Perhaps they changed the requirements while you weren’t looking. Or Am I reading this wrong?

      • self@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        only one of the 8 computers I own (and I’m not being cheeky here and counting embedded or retro systems, just laptops and desktops) is physically capable of meeting the model’s minimum requirements, and that’s only if I install chromium on the Windows gaming VM my bigger GPU’s dedicated to and access protonmail from there. nothing else I do needs a GPU that big, professional or otherwise — that hardware exists for games and nothing else. compared with the integrated GPUs most people have, a 2060’s fucking massive.

        do you see how these incredibly high system requirements (for a webmail client of all things), alongside them already treating the local model as strictly optional, can act as a funnel redirecting people towards the insecure cloud version of the feature? “this feature only works securely on one of the computers where you write mail, at best” feels like a dark pattern to me.

        • ShakingMyHead@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          5 months ago

          Unfortunately, “extremely expensive” and “high-end” aren’t really synonyms, thanks to, y’know, bitcoin. Of course, I don’t disagree with your argument that having to buy a GPU just to ensure your webmail does what it’s advertised to do is, well, dumb.

          What I don’t know is what the LLM even is. Did they just tack on Llama to their webmail app and call it a day? Did they train a model? Was it trained on emails? If so, whose emails? What an advertisement that would be: “Use Protonmail to encrypt your emails so that companies like Protonmail can’t use them to train an LLM.”

    • V0ldek@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      Jesus fucking christ…

      So where do I switch now? Is this the moment I build my own email server and handle this shit myself? I really don’t wanna…

        • self@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          5 months ago

          they have apparently promised they don’t plan on implementing anything AI-related which is good, though I’m honestly hoping for a system where our privacy isn’t entirely reliant on the promises of a single authority

          and I’m not saying we should do our own federated e2e email service, but somebody should

          …more realistically, I’ll probably switch to tuta when my proton account nears renewal, as I’m not a fan of how much pure unfiltered horseshit I’m seeing them output with the money I paid them

      • smiletolerantly@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        Setting up an email server is really straightforward with simple-nixos-mailserver, highly recommend. No idea how likely you are to be classified as spam though from a new domain

        • flere-imsaho@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          edit-2
          5 months ago

          i host my mail services for the last twenty seven years, and yeah, you’re talking shit. starting the smtp daemon is not the same as managing mail server.

          • self@awful.systems
            link
            fedilink
            English
            arrow-up
            0
            ·
            5 months ago

            i host my mail services for the last twenty seven years

            this is one of the circles of hell Dante didn’t comprehend when he wrote Inferno

          • froztbyte@awful.systems
            link
            fedilink
            English
            arrow-up
            0
            ·
            5 months ago

            coming up on 18y on mine. my postfix config is almost of legal drinking age in a lot of countries.

            modern email ecosystem is a fucking mess.

          • froztbyte@awful.systems
            link
            fedilink
            English
            arrow-up
            0
            ·
            5 months ago

            it’s also really, really fucking unpredictable, in the the-other-parties-do-not-reliably-behave-the-same way

            used to hate having to debug mail failing to deliver to yahoo, and now lately google has started filling that niche…

        • o7___o7@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          5 months ago

          eh, nix is experiencing a chudpocalypse at the moment, which might be why you’re catching strays

        • flowerysong@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          5 months ago

          I host my own email and for my day job I run an institutional email system that handles ~50 million messages per week. I can’t recommend hosting email at either end of that scale (or anywhere in between), and I find it difficult to believe that anyone with experience running a mail server would claim it’s reasonable or straightforward.

    • Mii@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      Who is the target audience for this?

      People who use Proton are privacy-conscious and mostly (I would argue) tech literate, and yet they shove spicy autocomplete that no one ever needed until two years ago and most people don’t want now because it produces complete horseshit, and spellchecking that every browser under then sun has built in by now.

      And then they quietly say you need to use Chromium, so the people who use anything but (like, I don’t know, the majority of privacy-conscious folks who should be their main user base, lol) have their e2e broken?

      I really hope they catch a raging firestorm for this.

      (Also I’m really pissed right now because used to recommend them to people and now feel like a total jackass for doing that.)

      • self@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        (Also I’m really pissed right now because used to recommend them to people and now feel like a total jackass for doing that.)

        don’t feel bad for making the best choice you could with the information of the past. until we get a workable, interoperable, federated, encrypted communication/online services platform, the choice was to recommend one of the centralized e2e providers. we both chose to recommend Proton and they did this shit, but it could have just as easily been tutanota.

        now my brain’s going “e2e encrypted federated email but it preferably uses activitypub as a transport and classic email as a fallback, is that anything”

        • self@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          5 months ago

          yep! that’s the game they’re playing. I really don’t give a fuck about Proton’s relatively tiny number of enterprise whales, but they make Proton a shitload of money in the short term.

          the depressing part is, historically, online services that remain uncompromisingly user-focused tend to stick around roughly forever, while the ones that chase short-term gains and compromise everything else almost always enshittify and fizzle out pretty quick.

  • BlueMonday1984@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    5 months ago

    Not a sneer, but an observation on the tech industry from Baldur Bjarnason, plus some of my own thoughts:

    I don’t think I’ve ever experienced before this big of a sentiment gap between tech – web tech especially – and the public sentiment I hear from the people I know and the media I experience.

    Most of the time I hear “AI” mentioned on Icelandic mainstream media or from people I know outside of tech, it’s being used as to describe something as a specific kind of bad. “It’s very AI-like” (“mjög gervigreindarlegt” in Icelandic) has become the talk radio short hand for uninventive, clichéd, and formulaic.

    Baldur has pointed that part out before, and noted how its kneecapping the consumer side of the entire bubble, but I suspect the phrase “AI” will retain that meaning well past the bubble’s bursting. “AI slop”, or just “slop”, will likely also stick around, for those who wish to differentiate gen-AI garbage from more genuine uses of machine learning.

    To many, “AI” seems to have become a tech asshole signifier: the “tech asshole” is a person who works in tech, only cares about bullshit tech trends, and doesn’t care about the larger consequences of their work or their industry. Or, even worse, aspires to become a person who gets rich from working in a harmful industry.

    For example, my sister helps manage a book store as a day job. They hire a lot of teenagers as summer employees and at least those teens use “he’s a big fan of AI” as a red flag. (Obviously a book store is a biased sample. The ones that seek out a book store summer job are generally going to be good kids.)

    I don’t think I’ve experienced a sentiment disconnect this massive in tech before, even during the dot-com bubble.

    Part of me suspects that the AI bubble’s spread that “tech asshole” stench to the rest of the industry, with some help from the widely-mocked NFT craze and Elon Musk becoming a punching bag par excellence for his public breaking-down of Twitter.

    (Fuck, now I’m tempted to try and cook up something for MoreWrite discussing how I expect the bubble to play out…)

    • YourNetworkIsHaunted@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      The active hostility from outside the tech world is going to make this one interesting, since unlike crypto this one seems to have a lot of legitimate energy behind it in the industry even as it becomes increasingly apparent that even if the technical capability was there (e.g. the bullshit problems could be solved by throwing enough compute and data at the existing paradigm, which looks increasingly unlikely) there’s no way to do it profitably given the massive costs of training and using these models.

      I wonder if we’re going to see any attempts to optimize existing models for the orgs that have already integrated them in the same way that caching a web page or indexing a database can increase performance without doing a whole rebuild. Nvidia won’t be happy to see the market for GPUs fall off, but OpenAI might have enough users of their existing models that they can keep operating even while dramatically cutting down on new training runs? Does that even make sense, or am I showing my ignorance here?

  • David Gerard@awful.systemsOPM
    link
    fedilink
    English
    arrow-up
    0
    ·
    5 months ago

    comment from friend:

    Slightly related: now I know when the AI crash is going to happen. Every bottomfeeder recruiter company on LinkedIn is suddenly pushing 2-month contract technical writer positions with AI companies with no product, no strategy, and no idea of how to proceed other than “CEO cashes out.” I suspect the idea is to get all of their documentation together so they can sell their bags of magic beans before the beginning of the holiday season.

    sickos.jpg

    I have asked if he can send me links to a few of these, I’ll see what I can do with 'em

    • blakestacey@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      That seems suspiciously soon, but my impression is based on nothing but vibes — a sense that companies are still buying in.

      • YourNetworkIsHaunted@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        I think there was a report saying that the most recent quarter still showed a massive infusion of VC cash into the space, but I’m not sure how much of that comes from the fact that a new money sink hasn’t yet started trending in the valley. It wouldn’t surprise me if the griftier founders were looking to cash out before the bubble properly bursts in order to avoid burning bridges with the investors they’ll need to get the next thing rolling.

        • David Gerard@awful.systemsOPM
          link
          fedilink
          English
          arrow-up
          0
          ·
          edit-2
          5 months ago

          We were asking around AI industry peons in March and they all guessed around three quarters too. I woulda put it at maybe two years myself, but I was surprised at so many people all arriving at around three quarters. OTOH, I would say that just in the past few months things are really obviously heading for a trauma.

            • David Gerard@awful.systemsOPM
              link
              fedilink
              English
              arrow-up
              0
              ·
              5 months ago

              crypto’s VC investment fell off a cliff after the crash, and that investment is what we were talking about there

              hence their pivot to AI

              • pyrex@awful.systems
                link
                fedilink
                English
                arrow-up
                0
                ·
                5 months ago

                Oh, OK. I think all the VC-adjacent people still really believe in crypto, if it helps. They probably also don’t believe in it, depending on the room. I think it will come back.

                • David Gerard@awful.systemsOPM
                  link
                  fedilink
                  English
                  arrow-up
                  0
                  ·
                  5 months ago

                  they’ve stopped putting fresh money in, but they believe fervently in the massive bags they’re holding

          • jonhendry@awful.systems
            link
            fedilink
            English
            arrow-up
            0
            ·
            5 months ago

            Perhaps that’s part of why so many SV types are backing Trump. Grifting off Trump may be their fallback after the AI bubble collapses.

          • froztbyte@awful.systems
            link
            fedilink
            English
            arrow-up
            0
            ·
            5 months ago

            I’m severely backlogged on catching up to things but my (total and complete) guess would be something like: all the recent headlines about funding and commitments are almost certainly imprecise in localisation and duration - everyone that “got money” didn’t necessarily get “money” but instead commitments to funding, and “everyone” is a much smaller set of entities that don’t encompass a really wide gallery of entities

            So for all the previously-extant promptfondlers/ model dilettantes/etc out there, the writing may indeed have been (and may still be) on the wall ito runway (“startup operating capital remaining available and viable to avoid death”)

            Based on the kind of headlines seen (and presuming the above supposition for the sake of argument), and the kind of utterly milquetoast garbage all the interceding months have produced, I don’t think it’s likely that much of the promised money will make it through to this layer/lot either. But that’s entirely a guess at this stage (and I can think of some fairly hefty counter-argument examples that may contribute to countering, not least because of how many people/orgs wouldn’t want to be losing face to fucking this up)

    • Architeuthis@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      5 months ago

      Current flavor AI is certainly getting demystified a lot among enterprise people. Let’s dip our toes into using an LLM to make our hoard of internal documents more accessible, it’s supposed to actually be good at that, right? is slowly giving way to “What do you mean RAG is basically LLM flavored elasticsearch only more annoying and less documented? And why is all the tooling so bad?”

      • imadabouzu@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        Maybe hot take, but I actually feel like the world doesn’t need strictly speaking more documentation tooling at all, LLM / RAG or otherwise.

        Companies probably actually need to curate down their documents so that simpler thinks work, then it doesn’t cost ever increasing infrastructure to overcome the problems that previous investment actually literally caused.

        • Architeuthis@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          5 months ago

          Companies probably actually need to curate down their documents so that simpler thinks work, then it doesn’t cost ever increasing infrastructure to overcome the problems that previous investment actually literally caused

          Definitely, but the current narrative is that you don’t need to do any of that, as long as you add three spoonfulls of AI into the mix you’ll be as good as.

          Then you find out what you actually signed up for is to do all the manual preparation of building an on-premise search engine to query unstructured data, and you still might end up with a tool that’s only slightly better than trying to grep a bunch of pdfs at the same time.

      • Mii@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        5 months ago

        “What do you mean RAG is basically LLM flavored elasticsearch only more annoying and less documented? And why is all the tooling so bad?”

        Our BI team is trying to implement some RAG via Microsoft Fabrics and Azure AI search because we need that for whatever reason, and they’ve burned through almost 10k for the first half of the running month already, either because it’s just super expensive or because it’s so terribly documented that they can’t get it to work and have to try again and again. Normal costs are somewhere around 2k for the whole month for traffic + servers + database and I haven’t got the foggiest what’s even going on there.

        But someone from the C suite apparently wrote them a blank check because it’s AI …

      • rook@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        What do you mean RAG is basically LLM flavored elasticsearch

        I always saw it more as LMGTFYaaS.

      • o7___o7@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        5 months ago

        Confucius, the Buddha, and Lao Tzu gather around a newly-opened barrel of vinegar.

        Confucius tastes the vinegar and perceives bitterness.

        The Buddha tastes the vinegar and perceives sourness.

        Lao Tzu tastes the vinegar and perceives sweetness, and he says, “Fellas, I don’t know what this is but it sure as fuck isn’t vinegar. How much did you pay for it?”

        • self@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          5 months ago

          so, uh, you remember AskJeeves?

          (alternative answer: the third buzzword in a row that’s supposed to make LLMs good, after multimodal and multiagent systems absolutely failed to do anything of note)

        • corbin@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          5 months ago
          NSFW (including funny example, don't worry)

          RAG is “Retrieval-Augmented Generation”. It’s a prompt-engineering technique where we run the prompt through a database query before giving it to the model as context. The results of the query are also included in the context.

          In a certain simple and obvious sense, RAG has been part of search for a very long time, and the current innovation is merely using it alongside a hard prompt to a model.

          My favorite example of RAG is Generative Agents. The idea is that the RAG query is sent to a database containing personalities, appointments, tasks, hopes, desires, etc. Concretely, here’s a synthetic trace of a RAG chat with Batman, who I like using as a test character because he is relatively two-dimensional. We ask a question, our RAG harness adds three relevant lines from a personality database, and the model generates a response.

          > Batman, what's your favorite time of day?
          Batman thinks to themself: I am vengeance. I am the night.
          Batman thinks to themself: I strike from the shadows.
          Batman thinks to themself: I don't play favorites. I don't have preferences.
          Batman says: I like the night. The twilight. The shadows getting longer.
          
        • pyrex@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          5 months ago

          It’s the technique of running a primary search against some other system, then feeding an LLM the top ~25 or so documents and asking it for the specific answer.

  • self@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    5 months ago

    surprising absolutely nobody who’s been paying attention, Fedora has signaled its intent to use generative AI and an LLM in its packaging software

    and I wouldn’t give a fuck what IBM’s pet distro does, but Red Hat’s developers have a high amount of control over what ends up in the userland… and bootloader… and pretty much every part of the system but the kernel cause they got told to fuck off, of every Linux distro but the obscure ones

    • V0ldek@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      I’m not really in on distros and related drama (strong “just fucking use Debian stable” camp), why did Red Hat get told to fuck off from the kernel?

      • swlabr@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        I started a job in the last year that really forced me to play around with different distros and sometimes building them. Pretty much my entire experience is “abandon ubuntu, just use debian” and wishing other people would do the same

        (Pretty much my entire reasoning is that snap fucked up my dev environment so bad I rage installed debian)

        • David Gerard@awful.systemsOPM
          link
          fedilink
          English
          arrow-up
          0
          ·
          edit-2
          5 months ago

          Ubuntu has been a reasonable Debian for our corporate purposes of late, and we have those vital legacy systems running on fucking 14.04 that nobody is going to pay to reimplement sanely that we are currently lining up to pay Canonical for hyperextended tick-box support while we also put them in a concrete sarcophagus with a 30km exclusion zone

          but some of the snap-based distro nonsense has me worrying

  • self@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    5 months ago

    speaking of technofascism, we’re at the stage where supposed Democrat billionaires like the Andreesen Horowitz fuckers suddenly come out in support of Trump:

    Marc Andreessen, the co-founder of one of the most prominent venture capital firms in Silicon Valley, says he’s been a Democrat most of his life. He says he has endorsed and voted for Bill Clinton, Al Gore, John Kerry, Barack Obama and Hillary Clinton.

    However, he says he’s no longer loyal to the Democratic Party. In the 2024 presidential race, he is supporting and voting for former President Donald Trump. The reason he is choosing Trump over President Joe Biden boils down primarily to one major issue — he believes Trump’s policies are much more favorable for tech, specifically for the startup ecosystem.

    none of this should be surprising, but it should be called out every time it happens, and we’re gonna see it happen a lot in the days ahead. these fuckers finally feel secure in taking their masks off, and that’s not good.

    • pyrex@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      5 months ago

      I don’t understand why people take him at face value when he claims he’s always been a Democrat up until now. He’s historically made large contributions to candidates from both parties, but generally more Republicans than Democrats, and also Republican PACs like Protect American Jobs. Here is his personal record.

      Since 2023, he picked up and donated ~$20,000,000 to Fairshake, a crypto PAC which predominantly funds candidates running against Democrats.

      Has he moved right? Sure. Was he ever left? No, this is the voting record of someone who wants to buy power from candidates belonging to both parties. If it implies anything, it implies he currently finds Republicans to be corruptible.

    • blakestacey@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      Apparently the “startup ecosystem” matters more than the ecosystem of, you know, actual living things.

      These people are just amazingly fucking evil.

    • David Gerard@awful.systemsOPM
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      Democrat?? AH’s previous hit was the one where they enthusiastically endorsed literally the co-author of the original Fascist manifesto

      and a16z does get Yarvin in to dispense wisdom and insight

      • YourNetworkIsHaunted@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        See, I feel like the Democrats have had a pretty strong technocrat wing that is much more in synch with Neoreaction than people care to acknowledge. As the right shifts towards pursuing the pro-racist anti-women anti-lgbt aspects of their agenda through the courts rather than the ballot box, it seems like the fault lines between the technocratic fascists and the theocratic fascists are thinner than the lines between the techfash and the progressives.

  • Soyweiser@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    5 months ago

    “Learning Nate Silver works for Peter Thiel is one of those things that would have shocked me in 2016 and made me wonder why I hadn’t already been assuming it in 2024.” He now works for the betting market polymarket (using cryptocurrencies of course).

    xcancel, twitter

  • Soyweiser@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    5 months ago

    NSFW, as NSAB, I know that anti-environmentalists shout a lot about ‘what about china china should go green first!’ while not knowing china is in fact doing a lot to try and go green (at least on the co2 energy front, I’m not asking here to go point out all the bad things china does to fuck up the environment). I see ‘we should develop AI before china does so’ be a big pro AI argument, so here is my question. Is china even working on massive A(G)I like the people claim?

    • Architeuthis@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      5 months ago

      I am overall very uninformed about the chinese thechnological day-to-day, but here’s two interesting facts:

      They set some pretty draconian rules early on about where the buck stops if your LLM starts spewing false information or (god forbid) goes against party orthodoxy so I’m assuming if independent research is happening It doesn’t appear much in the form of public endpoints that anyone might use.

      A few weeks ago I saw a report about chinese medical researchers trying use AI agents(?) to set up a virtual hospital in order to maybe eventually have some sort of a virtual patient entity that a medical student could work with somehow, and look how many thousands of virtual patients our handful of virtual doctors are healing daily, isn’t it awesome folks. Other than the rampant startupiness of it all, what struck me was that they said they had chatgpt-3.5 set up up the doctor/patient/nurse agents, i.e. they used the free version.

      So, who knows? If they are all-in in AGI behind the scenes they don’t seem to be making a big fuss about it.

      • Soyweiser@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        Thanks, you and froztbytes reply answered my questions on if they were doing it and also a bit on how seriously they are all taking it.

    • froztbyte@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      Typing from phone, please excuse lack of citations. Academic output in various parts of ML research have increasingly come from China and Chinese researchers over the past decade. There’s multiple inputs to this - funding, how strong a specific school/research centre is, etc, but it’s been ramping up. Pretty sure part of this is one of the fuel sources in keeping the pro-hegemonist US argument popular and going lately (also part of where the “we should before they do” comes from I guess)

      I’ve seen some mentions of recent legislation direction about LLM usage but I’m not fully up to scratch on what it is, haven’t had the time to read up

      • Soyweiser@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        Thanks I was not aware, so they are doing things regarding the research at least. So the “concern” isn’t totally made up. Which is what I wanted to know. As Architeuthis mentioned the legislation is against false info and against going against the party (which seem to be what you could expect).