Orpheus-3b-0.1-pretrained in GGUF format.
This model had some problems with the tokenizer, so I removed the last audio token (which doesn't seem to be used here) from the vocabulary to get llama.cpp to stop complaining about token_embd.weight size mismatch. It still seems to work fine.
- Downloads last month
- 48
Hardware compatibility
Log In to add your hardware
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for Zuellni/orpheus-3b-0.1-pt-GGUF
Base model
meta-llama/Llama-3.2-3B-Instruct Finetuned
canopylabs/orpheus-3b-0.1-pretrained