ggufs are available on huggingface, so it is open weight since ggufs can be converted back to safetensors, and the interesting part isn’t that it can run on Apple phones, but that it’s small enough to do so which means it’s very lightweight and will use less energy and run on smaller hardware setups https://huggingface.co/collections/prism-ml/bonsai-27b
ggufs are available on huggingface, so it is open weight since ggufs can be converted back to safetensors, and the interesting part isn’t that it can run on Apple phones, but that it’s small enough to do so which means it’s very lightweight and will use less energy and run on smaller hardware setups https://huggingface.co/collections/prism-ml/bonsai-27b