ExllamaV2 version of the model created by Undi!
Original Model https://huggingface.co/Undi95/ReMM-S-Kimiko-v2-13B
Requires ExllamaV2, which is being developed by turboderp https://github.com/turboderp/exllamav2 under an MIT license.
Main branch is 8bpw 8h (req 18gb)
6b8h branch is 6bpw 8h (req 16gb)
LoRA merged to a Model.
Model : https://huggingface.co/Undi95/ReMM-SLERP-L2-13B
LoRA : https://huggingface.co/nRuaif/Kimiko-v2-13B
Weight : 0.50
- Downloads last month
- 2