You must log in or register to comment.
Client on DS Lite. LLM on Mac.
Yeah, that’s not impressive at all compared to what I thought. It’s not much different than playing Crysis on a DS by just using remote desktop.
No actually, that would be impressive. The DS is barely capable of decoding video. Getting that to work in real time, over the network, and low latency is a huge technical achievement.
This is just a text input and output connected to a remote machine.
Maybe not the perfect example, but then again, getting Crysis to run natively on a DS would be a significantly larger achievement than running a video streamer.
Uhm, I figured out that people don’t like it. However, for me, it was a nice little project and it brightened my day.
Yeah, it was definitely the title. It’s a neat project in of itself, but the title made it seem like you accomplished a frankly massive feat.
Videos like this one where they make absolutely tiny llm models for low power hardware are what I had in mind. Sadly I can’t find the other one that I watched several months back.
That’s really cool!
Out of topic, but I’m unreasonably happy that you use the more exact word “LLM” instead of AI. Cool project!
Thank you, you know these days small things make me happy
Which part is selfhosted?
all of it. I’m not using anything outside of my own local area network.
Please share the full stack with us
I use the Kaico DSpico Flashcart and on the RPi Zero 2W I use a bash script (because I don’t want to host it permanently) with hostapd, iw, dnsmasq, socat, and iproute2. For HTTP and JSON I use my own implementation, no library. The rest is documented in the post.
Did some experiments with my DS Lite and ended up with this. Using DevkitPro libs (libnds, dswifi, calico). Apfel on macOS and a wifi (WEP) bridge running on a RPi Zero 2W. 🖤
Doesn’t the DS… just have a browser? Meaning you’re just pointing at a web page here?
Yes but this isn’t a full browser, just an API client.
So, even more extra steps for even less functionality, got it.
