• Pennomi@lemmy.world
    link
    fedilink
    English
    arrow-up
    39
    ·
    11 months ago

    We don’t need faster GPUs as much as we need more VRAM. Double the memory instead of leaving it stagnant again.

    • BigDaddySlim@lemmy.world
      link
      fedilink
      English
      arrow-up
      36
      ·
      11 months ago

      It’s not just the lack of VRAM, it’s also Nvidia and their stupidity lowering the bit bus for lower tier cards compared to the last gen counterparts.

    • 9488fcea02a9@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      1
      ·
      11 months ago

      I dont understand the VRAM cuts… The RAM fabs have been cutting production because of low prices

      I would love more VRAM so that i can have a GPU that can do a bit of gaming and dabble in some AI stuff. 100% agree i’d pay for more VRAM instead of horsepower

      • CaptainProton@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        ·
        11 months ago

        More memory means you can do real work with it, and enterprise AI training is a money printer that they’d be scavenging the shit out of with cards that are closer substitutes.

        • tal@lemmy.today
          link
          fedilink
          English
          arrow-up
          1
          ·
          11 months ago

          Honestly, the gap between the server parallel compute cards and the home video cards isn’t that large. 24GB on video cards, 80GB for a compute card.

          That’s not even two binary orders of magnitude. That’s a narrow window to try to make their money from. Plus, some tasks can be subdivided and run on multiple GPUs, and they can’t segment up the market for those.

          Like, in general, my bet is that when for most things that fit the above requirements of fitting in that window and having a task that can’t be subdivided, there’s probably enough room for algorithmic improvements to get two binary orders of magnitude of reduction in memory requirements.

    • CaptainProton@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      11 months ago

      But then you can do work with it, and that’s where the real money is at.

      They should all be shipping with 32GB now… AMD is at least seeing the light by releasing some 24gb cards under $1k

      Really hope Intel’s next generation of GPU silicon makes it a more realistic substitute - that would actually spice things up a lot, you basically won’t see real competition again until nVidia’s AI training dominance is in someone’s crosshairs