Inference Providers
Active filters: autoawq
hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Text Generation
• Updated • 133k
• 109
curiousmind147/microsoft-phi-4-AWQ-4bit-GEMM
Text Generation
• 15B • Updated • 450
• 2
mconcat/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-AWQ-4bit
Text Generation
• 29B • Updated • 2.06k
• 2
mconcat/Qwopus3.5-27B-v3-AWQ-4bit
Text Generation
• 29B • Updated • 4.41k
• 1
Text Generation
• 7B • Updated • 462
• 2
Text Generation
• 6B • Updated • 8
kaitchup/Llama-3-8b-awq-4bit
Text Generation
• 8B • Updated • 9
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k
Text Generation
• Updated • 32
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GGUF
Text Generation
• Updated • 23
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GPTQ
Text Generation
• Updated • 7
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-AWQ
Text Generation
• Updated • 4
hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4
Text Generation
• 410B • Updated • 1.19k
• 36
hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Text Generation
• Updated • 270k
• 89
jburmeister/Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Text Generation
• 71B • Updated • 9
jburmeister/Meta-Llama-3.1-405B-Instruct-AWQ-INT4
Text Generation
• 410B • Updated • 4
Kalei/Meta-Llama-3.1-70B-Instruct-AWQ-INT4-Custom
Text Generation
• 71B • Updated • 8
UCLA-EMC/Meta-Llama-3.1-8B-AWQ-INT4
Text Generation
• 8B • Updated • 67
UCLA-EMC/Meta-Llama-3.1-8B-Instruct-AWQ-INT4-32-2.17B
Text Generation
• 8B • Updated • 16
• 1
reach-vb/Meta-Llama-3.1-8B-Instruct-AWQ-INT4-fix
Text Generation
• 8B • Updated • 3
jburmeister/Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Text Generation
• 8B • Updated • 22
awilliamson/Meta-Llama-3.1-70B-Instruct-AWQ
Text Generation
• 71B • Updated • 15
flowaicom/Flow-Judge-v0.1-AWQ
Text Generation
• 4B • Updated • 5.1k
• 6
hugging-quants/Mixtral-8x7B-Instruct-v0.1-AWQ-INT4
Text Generation
• 47B • Updated • 9.21k
hugging-quants/gemma-2-9b-it-AWQ-INT4
Text Generation
• 9B • Updated • 1.5k
• 8
ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4
Text Generation
• 71B • Updated • 828
• 6
NeuML/Llama-3.1_OpenScholar-8B-AWQ
Text Generation
• 8B • Updated • 33
• 3
fbaldassarri/TinyLlama_TinyLlama_v1.1-autoawq-int4-gs128-asym
Text Generation
• 1B • Updated • 4
fbaldassarri/TinyLlama_TinyLlama_v1.1-autoawq-int4-gs128-sym
Text Generation
• 1B • Updated • 3
fbaldassarri/EleutherAI_pythia-14m-autoawq-int4-gs128-asym
Text Generation
• 14.1M • Updated • 1
fbaldassarri/EleutherAI_pythia-14m-autoawq-int4-gs128-sym
Text Generation
• 14.1M • Updated • 1