GPTQ Quants
updated
thesven/Mistral-7B-Instruct-v0.3-GPTQ
Text Generation
• 7B • Updated • 66k
• 1
thesven/Phi-3.5-mini-instruct-GPTQ-4bit
Text Generation
• 4B • Updated • 259
• 1
thesven/Phi-nut-Butter-Codebagel-v1-GPTQ
Text Generation
• 4B • Updated • 4
thesven/Aether-Qwen2-0.5B-SFT-v0.0.2-GPTQ
Text Generation
• 0.5B • Updated • 7
thesven/microsoft_WizardLM-2-7B-GPTQ
Text Generation
• 7B • Updated • 4
thesven/prometheus-7b-v2.0-GPTQ
Text Generation
• 7B • Updated • 27
thesven/Meta-Llama-3.1-8B-Instruct-GPTQ
Text Generation
• 8B • Updated • 3
thesven/gemma-2-9b-it-GPTQ
Text Generation
• 9B • Updated • 1
thesven/Mistral-7B-v0.3-GPTQ
Text Generation
• 7B • Updated • 3
thesven/openchat-3.6-8b-20240522-GPTQ
Text Generation
• 8B • Updated • 1
thesven/Llama-3-8B-GPTQ-4bit
Text Generation
• 8B • Updated • 17
thesven/microsoft_WizardLM-2-7B-GPTQ-98k
Text Generation
• 7B • Updated • 1
thesven/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation
• 7B • Updated • 10
• 1
thesven/falcon-11B-GPTQ-4bit
Text Generation
• 11B • Updated • 7