ggufs are available on huggingface, so it is open weight since ggufs can be converted back to safetensors, and the interesting part isn’t that it can run on Apple phones, but that it’s small enough to do so which means it’s very lightweight and will use less energy and run on smaller hardware setups https://huggingface.co/collections/prism-ml/bonsai-27b
Interesting, but not open weight and only seems to work on Apple devices (and NVIDIA GPUs but do any phones have those?)
ggufs are available on huggingface, so it is open weight since ggufs can be converted back to safetensors, and the interesting part isn’t that it can run on Apple phones, but that it’s small enough to do so which means it’s very lightweight and will use less energy and run on smaller hardware setups https://huggingface.co/collections/prism-ml/bonsai-27b