hugging-quants

/

Meta-Llama-3.1-405B-Instruct-GPTQ-INT4

like 16

Follow

Hugging Quants 289

Reference: https://huggingface.co/meta-llama/Meta-Llama-3.1-405B-Instruct/commit/f9801cba95a53242b3cc928a4a418d12571d1c5f

Closing this PR since there are additional changes in eos_token settings, so I'll create a new PR addresses all the diffs