Hugging Face's logo

lucyknada
/
NeverSleep_Lumimaid-v0.2-70B-exl2-5.0bpw

Text Generation
Transformers
PyTorch
llama
conversational
text-generation-inference
5-bit
exl2
Model card Files
xet
 Community
1

4.0bpw or 4.5bpw

#1
by Adzeiros - opened
Discussion
Adzeiros

Will you be making 4.0bpw or 4.5bpw of this model?
lucyknada
 Owner

I wouldn't mind doing one, but there seems to be one already: https://huggingface.co/MississippiKing/Lumimaid-v0.2-70B-exl2/tree/4bpw

lucyknada changed discussion status to closed
Adzeiros

@lucyknada Thanks but I don't trust new accounts that literally only have 1 upload haha

lucyknada changed discussion status to open
lucyknada
 Owner

tomorrow
lucyknada
 Owner

https://huggingface.co/lucyknada/NeverSleep_Lumimaid-v0.2-70B-exl2-4.0bpw

lucyknada changed discussion status to closed

Sign up or log in to comment