☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to technology@hexbear.netEnglish · 1 month agoTokasaurus: An LLM Inference Engine for High-Throughput Workloadsscalingintelligence.stanford.eduexternal-linkmessage-square0linkfedilinkarrow-up111arrow-down10cross-posted to: ai_@lemmy.worldtechnology@lemmy.mlhackernews@lemmy.bestiver.se
arrow-up111arrow-down1external-linkTokasaurus: An LLM Inference Engine for High-Throughput Workloadsscalingintelligence.stanford.edu☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to technology@hexbear.netEnglish · 1 month agomessage-square0linkfedilinkcross-posted to: ai_@lemmy.worldtechnology@lemmy.mlhackernews@lemmy.bestiver.se