Inference Providers
Active filters: 5-bit
MaziyarPanahi/Llama-3.2-3B-bf16-GGUF
Text Generation
• 3B • Updated • 48
• 2
roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q5_K_M-GGUF
Text Generation
• 8B • Updated • 502
• 2
BlueMoonlight/DeepSeek-R1-Distill-Qwen-14B-mlx-5Bit
Text Generation
• 15B • Updated • 587
• 1
LiquidAI/LFM2.5-350M-MLX-5bit
Text Generation
• 66.5M • Updated • 251
• 3
NexVeridian/gemma-4-31B-5bit
Text Generation
• 31B • Updated • 318
• 1
NexVeridian/gemma-4-31B-it-5bit
Text Generation
• 31B • Updated • 393
• 1
LiquidAI/LFM2.5-VL-450M-MLX-5bit
Image-Text-to-Text
• 0.2B • Updated • 36
• 1
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation
• 7B • Updated • 121k
• 135
LoneStriker/Yi-6B-200K-5.0bpw-h6-exl2
Text Generation
• Updated • 1
Text Generation
• 3B • Updated • 228
• 6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 583
• 6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 547
• 4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
• 7B • Updated • 609
• 5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
• 7B • Updated • 258
• 3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation
• 7B • Updated • 137
• 2
MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 107
• 2
MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 73
• 2
MaziyarPanahi/Mistral-7B-Instruct-SQL-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 232
• 1
MaziyarPanahi/mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 112
• 1
MaziyarPanahi/tiledfloor-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 64
• 1
MaziyarPanahi/Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 98
• 1
MaziyarPanahi/Commonsense-QA-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 106
• 1
MaziyarPanahi/BASH-Coder-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 273
• 6
MaziyarPanahi/finetuned-mistral-7b-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 90
MaziyarPanahi/Mistral-7B-Instruct-guidance-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 115
MaziyarPanahi/KAI-7B-Instruct-v0.1-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 86
MaziyarPanahi/openbuddy-zephyr-7b-v14.1-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 78
MaziyarPanahi/japanese-stablelm-instruct-gamma-7b-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 175
MaziyarPanahi/mistral-ft-optimized-1227-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 81
MaziyarPanahi/zephyr-7b-sft-full-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 80