Hugging Face's logo

LoneStriker
/
Air-Striker-Mixtral-8x7B-Instruct-ZLoss-AWQ

Text Generation
Transformers
Safetensors
English
mixtral
mergekit
Merge
conversational
text-generation-inference
4-bit precision
awq
Model card Files
xet
 Community
1

Request for quantization

#1
by Kotokin - opened
Discussion
Kotokin

Hi, can you please quantize this model? sophosympatheia/Midnight-Rose-70B-v1.0
LoneStriker
 Owner

Hi, can you please quantize this model? sophosympatheia/Midnight-Rose-70B-v1.0

I'll add it to the list.
LoneStriker
 Owner

Quants up here: https://huggingface.co/models?search=LoneStriker%20Midnight-Rose-70B-v1.0
Kotokin

Thanks a lot

Kotokin changed discussion status to closed

Sign up or log in to comment