YAML Metadata Error:"base_model" with value "https://huggingface.co/advanced-stack/MistralAI-v0.1-GGUF" is not valid. Use a model id from https://hf.co/models.
Mistral 7b
Support for calm
These models support the calm language model runner. The particular quants selected for this repo are in support of calm, which is a language model runner that automatically uses the right prompts, templates, context size, etc.
From https://mistral.ai
Mistral-7B-v0.1 is a small, yet powerful model adaptable to many use-cases. Mistral 7B is better than Llama 2 13B on all benchmarks, has natural coding abilities, and 8k sequence length. It’s released under Apache 2.0 licence. We made it easy to deploy on any cloud, and of course on your gaming GPU
- Downloads last month
- 42
Hardware compatibility
Log In to add your hardware
4-bit
6-bit
16-bit