GGUF
vllm
mistral-common
conversational

Calibration data

#1
by icefog72 - opened

Hi, could you tell me if a calibration dataset was used to create these gguf quantizations? If so, is the dataset available for us to review? Thanks.

Mistral AI_ org

Hey we use the llama-quantize tool from llama.cpp !

juliendenize changed discussion status to closed

Sign up or log in to comment