Model description
- Developed by: teleboas
- License: apache-2.0
- Finetuned from model : unsloth/mistral-7b-v0.2-bnb-4bit
This is the GGUF version of the model, made for the llama.cpp inference engine.
If you are looking for the transformers/fp16 model, it is available here: https://huggingface.co/teleboas/alpaca_mistral-7b-v0.2
- Downloads last month
- 6
Hardware compatibility
Log In to add your hardware
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for teleboas/alpaca_mistral-7b-v0.2-GGUF
Base model
unsloth/mistral-7b-v0.2-bnb-4bit