Guess what, GPU prices are about to go back up because they rely on RAM.
GPU is a processor, right? It is the gfx card that will increase in price
You are the worst kind of person.
Respectfully disagree
I also don’t think you are the absolute worst.
Not for long, GPU partners will have to source their own VRAM for manufacturing Nvidia now.
I hope this is the beginning of the end for the cuda monopoly. I just want good gpgpu support for numerical code.
So… the models are all trained up and now they need to run them is what I’m reading.
You need lots of vram to train a model.
An llm once trained can be run in much less vram and a lot of ram
Buying used RAM on marketplace and hoping it isn’t broken. Hoping it was just stolen from a Best Buy. Fingers crossed y’all!
… I was thinking about buying a 96GB DDR5 kit from the local computer store a few weeks ago, but wasn’t sure it was actually worth €700. Checked again now and the exact same product costs €1500. I guess that settles it, 32GB will have to be enough for the next couple of years then.
This is very unfortunate, about a year ago I built my PC and only put in 32 GB of Ram, It was double I had on my laptop so I thought it should be enough for the beginning and I could buy more later.
Already after 2 months I realizes I can do so much more because of the fast CPU in parallel but suddenly the amount of RAM became the bottleneck. When I looked at the RAM prices it didn’t seem quite worth it and I waited. But that backfired because since then the prices never went down, only up.
I just had a look, 2nd of April I payed 67,000 KRW for one 16 GB stick, now the same one (XPG DDR5 PC5-48000 CL30 LANCER BLADE White), they only sell them in pairs, a pair costs 470,000 KRW in the same shop, so 235,000 KRW per 16 GB stick. That is a price increase of 250%, god damn.
Switch to Linux, double your available RAM for free.
I’ve been on Linux since 2002.
Then use a distribution from 2002 it uses less ram.
/s
What are you running that needs more than 32Gb? I’m only just barely being bottlenecked by my 24Gb when running games at 4k
Chrome probably
Two browsers full of tabs but that is not a problem, but once I start compiling AOSP (which I sometimes want to do for work at home instead in the cloud because it’s easier and faster to debugg) then it eats up all the RAM imediatelly and I have to give it 40 more GB or swap and then this swapping is the bottleneck. Once that is running the computer can’t really do anything else, even the browser struggles.
Jam it right in my ass!
You mean ‘ram’ it?
Oh I like you you can come over and fuck my wife.
Just buy an extra GPU and figure out how to turn it’s VRAM into regular RAM. 😌
I know you can create a gpu ram disk so you could use it as swap lol.
Ok, I have to know: how is this done, and what do people use it for?
It uses a github repo that hasn’t been updated in 3 years and it’s more of a gimmick but it’s a fun weekend project.
