casperhansen
/

mistral-small-24b-instruct-2501-awq

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

tekken.json from the original repo is missing and fails when running on vLLM

#2 opened about 1 year ago by

Comparison to older-type AWQ quants?

#1 opened about 1 year ago by