Fifty million polygons processed by over 7 hundred thousand processing cores (Intel iGPU), versus 4 million tokens processed by a single execution unit (with some instruction reordering tricky).
You’re right, I looked up the highest Intel GPU count but forgot that they released desktop cards. Intel iGPUs “only” have 768 cores, it’s the Ampere cards that have thousands of cores.
JSON is UTF-8 so it can be up to three bytes per token theoretically. Depends on the language you’re processing, I guess.
Fifty million polygons processed by over 7 hundred
thousandprocessing cores (Intel iGPU), versus 4 million tokens processed by a single execution unit (with some instruction reordering tricky).yea we need multithreaded json parsers
CUDA accelerated JSON parser is sorely needed
Doesn’t a 3070 have less than 7k cores? A UHD 750 (relatively recent iGPU) only has 256.
And I don’t know the structure of JSON that well, but can’t tokens be made of multiple chars?
You’re right, I looked up the highest Intel GPU count but forgot that they released desktop cards. Intel iGPUs “only” have 768 cores, it’s the Ampere cards that have thousands of cores.
JSON is UTF-8 so it can be up to three bytes per token theoretically. Depends on the language you’re processing, I guess.