Some of my own quants:
- CarbonVillain-en-10.7B-v1_Q5_K_M.gguf
- CarbonVillain-en-10.7B-v1_Q8_0.gguf
Source: jeonsworld
Source Model: CarbonVillain-en-10.7B-v1
Source models for jeonsworld/CarbonVillain-en-10.7B-v1 (Merge)
Models utilizing jeonsworld/CarbonVillain-en-10.7B-v1
- jeonsworld/CarbonVillain-en-10.7B-v3 (Ref) (Merge)
- kekmodel/StopCarbon-10.7B-v5 (Ref) (Merge)
- Downloads last month
- 11
Hardware compatibility
Log In to add your hardware
5-bit
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support