Some of my own quants:
- llama-2-13b-chat-limarp-v2-merged_Q5_1_4K.gguf
- llama-2-13b-chat-limarp-v2-merged_Q5_1_8K.gguf
Source: Doctor-Shotgun
Source Model: llama-2-13b-chat-limarp-v2-merged
Source models for Doctor-Shotgun/llama-2-13b-chat-limarp-v2-merged (Merge)
Models utilizing Doctor-Shotgun/llama-2-13b-chat-limarp-v2-merged
- Undi95/UndiMix-v1-13b (Ref) (Merge)
- Downloads last month
- -
Hardware compatibility
Log In to add your hardware
5-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support