• wonderingwanderer@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    Yeah, self-hosted open-source models seem okay, as long as their training data is all from the public domain.

    Hopefully RAM becomes cheap as fuck after the bubble pops and all these data centers have to liquidate their inventory. That would be a nice consolation prize, if everything else is already fucked anyway.

    • addie@feddit.uk
      link
      fedilink
      English
      arrow-up
      2
      ·
      4 months ago

      Unfortunately, server RAM and GPUs aren’t compatible with desktops. Also, NVidia have committed to releasing a new GPU every year, making the existing ones worth much less. So unless you’re planning to build your own data centre with slightly out-of-date gear - which would be folly, the existing ones will be desperate to recoup any investment and selling cheap - then it’s all just destined to become a mountain of e-waste.

      • wonderingwanderer@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        2
        ·
        4 months ago

        Maybe that surplus will lay the groundwork for a solarpunk blockchain future?

        I don’t know if I understand what blockchain is, honestly. But what if a bunch of indie co-ops created a mesh network of smaller, more sustainable server operations?

        It might not seem feasible now, but if the AI bubble pops, Nvidia crashes spectacularly, data centers all need to liquidate their stock, and server compute becomes basically viewed as junk, then it might become possible…

        I’m just trying to find a silver lining, okay?