Inference Providers
Active filters: 4-bit
TheBloke/SauerkrautLM-Mixtral-8x7B-GPTQ
Text Generation
• 47B • Updated • 9
• 2
ybelkada/Mixtral-8x7B-Instruct-v0.1-bnb-4bit
Text Generation
• 47B • Updated • 47
• 59
unsloth/mistral-7b-bnb-4bit
Text Generation
• 7B • Updated • 25.9k
• 30
xDAN-AI/xDAN-L1-Chat-RL-v1-awq
Text Generation
• 7B • Updated YashRawal225/TheQuant-GPTQ
Text Generation
• 7B • Updated • 2
TheBloke/Nous-Hermes-2-Yi-34B-AWQ
Text Generation
• 34B • Updated • 7.75k
• 7
TheBloke/Nous-Hermes-2-Yi-34B-GPTQ
Text Generation
• 34B • Updated • 270
• 6
TheBloke/Noromaid-v0.1-mixtral-8x7b-Instruct-v3-GPTQ
Text Generation
• 47B • Updated • 18
• 2
TheBloke/Noromaid-v0.1-mixtral-8x7b-Instruct-v3-AWQ
Text Generation
• 47B • Updated • 13
• 1
TheBloke/xDAN-L1-Chat-RL-v1-AWQ
Text Generation
• 7B • Updated • 7
• 1
TheBloke/xDAN-L1-Chat-RL-v1-GPTQ
Text Generation
• 7B • Updated • 10
• 3
TheBloke/Yi-34B-200K-AEZAKMI-v2-GPTQ
Text Generation
• 34B • Updated • 10
• 2
TheBloke/Yi-34B-200K-AEZAKMI-v2-AWQ
Text Generation
• 34B • Updated • 9
• 2
TheBloke/openthaigpt-1.0.0-beta-13B-chat-GPTQ
Text Generation
• 13B • Updated • 7
• 3
TheBloke/openthaigpt-1.0.0-beta-13B-chat-AWQ
Text Generation
• 13B • Updated • 7
• 1
TheBloke/neural-chat-7B-v3-3-wizardmath-dare-me-AWQ
Text Generation
• 7B • Updated • 9
• 1
TheBloke/openchat-3.5-1210-starling-slerp-AWQ
Text Generation
• 7B • Updated • 8
• 1
VictorNanka/phi-2-sft-lora
Text Generation
• Updated • 5
TheBloke/neural-chat-7B-v3-3-wizardmath-dare-me-GPTQ
Text Generation
• 7B • Updated • 12
• 1
TheBloke/openchat-3.5-1210-starling-slerp-GPTQ
Text Generation
• 7B • Updated • 4
• 4
unsloth/codellama-34b-bnb-4bit
Text Generation
• 35B • Updated • 127
• 4
7B • Updated • 5
CambioMoney/mixtral-instruct-MLFlowV4
Text Generation
• 47B • Updated • 4
• 1
TheBloke/MixtralOrochi8x7B-AWQ
Text Generation
• 47B • Updated • 8
• 2
TheBloke/MixtralOrochi8x7B-GPTQ
Text Generation
• 47B • Updated • 16
• 7
ace2105/mistral-indian-rights
Text Generation
• 7B • Updated • 1
unsloth/llama-2-13b-bnb-4bit
Text Generation
• 13B • Updated • 997
• 7
TheBloke/Silicon-Maid-7B-AWQ
Text Generation
• 7B • Updated • 4
• 9
TheBloke/Silicon-Maid-7B-GPTQ
Text Generation
• 7B • Updated • 39
• 25
msamon/AdaptLLM-finance-chat-AWQ
Text Generation
• 7B • Updated • 4
• 1