QuantFactory/Hathor_Sofit-L3-8B-v1-GGUF
This is quantized version of Nitral-AI/Hathor_Sofit-L3-8B-v1 created using llama.cpp
Original Model Card
Hathor_Sofit [v1] is designed to seamlessly integrate the qualities of creativity, intelligence, and robust performance.
GGUF Quant's available Thanks to: Mradermacher <3 GGUF Here
EXL2 Quant's available Thanks to RiveRiPH <3 Exl2 8bpw Here Exl2 6.3bpw Here
Recomended ST Presets: Hathor Presets(Updated)
Training-Note: Hathor_Sofit [v1] is trained on 1 epoch of Private - STEM (Intruction/Dialogs), Hathor_0.5 Instructions, mixture of creative writing data (light/web/classical novels), roleplaying chat pairs over Hathor_0.85.
Additional Notes: This will be the last of the Hathor Model series, and all my trains over Llama 3.
- Downloads last month
- 2
Hardware compatibility
Log In to add your hardware
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support