I got 32 additional GB of ram at a low, low cost from someone. What can I actually do with it?

  • SuperSpruce@lemmy.zip
    link
    fedilink
    arrow-up
    3
    arrow-down
    1
    ·
    7 days ago

    Keep it and wait for the applications to bloat up. You won’t feel like you have an excessive amount of RAM in a few years.

  • ausMuenster@feddit.org
    link
    fedilink
    English
    arrow-up
    1
    ·
    7 days ago

    You can run AI Models in it. Probably ones with 70b or up to 60b of you want to do other stuff while running them.

  • scarilog@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    7 days ago

    I built my PC recently and splurged to get about 100gb of ddr5, thinking it was going to be a waste of money.

    I couldn’t have been more wrong, there are occasionally times when I’m almost running out of memory. How? Multiple desktops, each with tons of programs and stuff open, including probably like several hundred Firefox tabs open at the worst of times.

    Basically, extra ram has allowed me to kinda postpone the responsibility of having the close programs, maintain cleanliness, etc. I still have to stay organised using desktops so I don’t go crazy with the number of things I have open, but I’m the limiting factor here, not my computer. And that’s a super liberating feeling.

    TL;DR: you can NEVER have too much ram.

      • Onno (VK6FLAB)@lemmy.radio
        link
        fedilink
        arrow-up
        16
        ·
        8 days ago

        I realise that you are making a joke, but here’s what I used it for:

        • Debian VM as my main desktop
        • Debian VN as my main Docker host
        • Windows VM for a historical application
        • Debian VM for signal processing
        • Debian VM for a CNC

        At times only the first two or three were running. I had dozens of purpose built VM directories for clients, different hardware emulation, version testing, video conferencing, immutable testing, data analysis, etc.

        My hardware failed in June last year. I didn’t lose any data, but the hardware has proven hard to replace. Mind you, it worked great for a decade, so, swings and roundabouts.

        I’m currently investigating, evaluating and costing running all of this in AWS. Whilst it’s technically feasible, I’m not yet convinced of actual suitability.

          • Onno (VK6FLAB)@lemmy.radio
            link
            fedilink
            arrow-up
            5
            ·
            8 days ago

            In my case, I’m not a fan of running unknown code on the host. Docker and LXC are ways of running a process in a virtual security sandbox. If the process escapes the sandbox, they’re in your host.

            If they escape inside a VM, that’s another layer they have to penetrate to get to the host.

            It’s not perfect by any stretch of the imagination, but it’s better than a hole in the head.

  • vividspecter@lemm.ee
    link
    fedilink
    arrow-up
    29
    ·
    8 days ago
    • Compressed swap (zram)

    • Compiling large C++ programs with many threads

    • Virtual machines

    • Video encoding

    • Many Firefox tabs

    • Games

  • zkfcfbzr@lemmy.world
    link
    fedilink
    English
    arrow-up
    21
    ·
    8 days ago

    I have 16 GB of RAM and recently tried running local LLM models. Turns out my RAM is a bigger limiting factor than my GPU.

    And, yeah, docker’s always taking up 3-4 GB.

      • zkfcfbzr@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        8 days ago

        Fair, I didn’t realize that. My GPU is a 1060 6 GB so I won’t be running any significant LLMs on it. This PC is pretty old at this point.

        • fubbernuckin@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          1
          ·
          8 days ago

          You could potentially run some smaller MoE models as they don’t take up too much memory while running. I’d suspect the deepseek r1 8B distill with some quantization would work well.

          • zkfcfbzr@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            8 days ago

            I tried out the 8B deepseek and found it pretty underwhelming - the responses were borderline unrelated to the prompts at times. The smallest I had any respectable output with was the 12B model - which I was able to run, at a somewhat usable speed even.

  • Jesus_666@lemmy.world
    link
    fedilink
    arrow-up
    21
    arrow-down
    1
    ·
    8 days ago

    Run a fairly large LLM on your CPU so you can get the finest of questionable problem solving at a speed fast enough to be workable but slow enough to be highly annoying.

    This has the added benefit of filling dozens of gigabytes of storage that you probably didn’t know what to do with anyway.

  • spicy pancake@lemmy.zip
    link
    fedilink
    English
    arrow-up
    17
    arrow-down
    1
    ·
    8 days ago

    Fold At Home!

    https://foldingathome.org/

    You can essentially donate your processing power to various science projects that need it to compute protein folding simulations. I used to run it whenever I wasn’t actively using my PC. This does cost electricity and increase rate of wear and tear on the device, as with any sustained high computational load. But it’s cool! :]