Extreme Compression of Large Language Models via Additive Quantization
Paper • 2401.06118 • Published • 14
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
WARNING: this checkpoint might be obsolete. Please use the updated Mixtral checkpoint.
Official AQLM quantization of mistralai/Mixtral-8x7B-v0.1.