Some of my own quants:

  • llama-2-13b-chat-limarp-v2-merged_Q5_1_4K.gguf
  • llama-2-13b-chat-limarp-v2-merged_Q5_1_8K.gguf

Source: Doctor-Shotgun

Source Model: llama-2-13b-chat-limarp-v2-merged

Source models for Doctor-Shotgun/llama-2-13b-chat-limarp-v2-merged (Merge)

Models utilizing Doctor-Shotgun/llama-2-13b-chat-limarp-v2-merged

Downloads last month
-
GGUF
Model size
13B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

5-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support