Pretty cool and fast model
Was not sure about the licensing so did not share the space happy to do so if there is interest in a WebGPU demo.
Was not sure about the licensing so did not share the space happy to do so if there is interest in a WebGPU demo.
From here:
We hope that the release of this model will make community-based research efforts more accessible, by releasing the weights of a highly performant 111 billion parameter model to researchers all over the world. This model is governed by a CC-BY-NC License (Non-Commercial) with an acceptable use addendum, and also requires adhering to Cohere Lab's Acceptable Use Policy. If you are interested in commercial use, please contact Cohere’s Sales team.
So, you may use it if you are building something non-commercial. 😀 We also published a WebGPU demo at https://huggingface.co/spaces/webml-community/TinyAya-WebGPU