Inference Providers
Active filters: 70b
mradermacher/Llama3.1-70B-PlumChat-GGUF
71B • Updated • 48
mradermacher/Llama3.1-70B-PlumChat-i1-GGUF
71B • Updated • 113
mradermacher/CodeLlama-70B-Esper-GGUF
69B • Updated • 86
mradermacher/CodeLlama-70B-Esper-i1-GGUF
69B • Updated • 131
• 1
tensorblock/Llama3-70B-ShiningValiant2-GGUF
Text Generation
• 71B • Updated • 2
tensorblock/Llama3-70B-Fireplace-GGUF
Text Generation
• 71B • Updated • 266
hierholzer/Llama-3.3-70B-Instruct-GGUF
Text Generation
• 71B • Updated • 77
• 1
mradermacher/Llama2-70B-StellarBright-GGUF
69B • Updated • 67
mradermacher/Llama2-70B-StellarBright-i1-GGUF
69B • Updated • 241
roleplaiapp/Llama-3.3-70B-Instruct-Q5_0-GGUF
Text Generation
• 71B • Updated • 4
roleplaiapp/Llama-3.3-70B-Instruct-Q5_K_S-GGUF
Text Generation
• 71B • Updated • 5
roleplaiapp/Llama-3.3-70B-Instruct-Q5_K_M-GGUF
Text Generation
• 71B • Updated • 80
roleplaiapp/Llama-3.3-70B-Instruct-Q6_K-GGUF
Text Generation
• 71B • Updated • 23
roleplaiapp/Llama-3.3-70B-Instruct-Q8_0-GGUF
Text Generation
• 71B • Updated • 14
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q2_K-GGUF
Text Generation
• 71B • Updated • 19
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S-GGUF
Text Generation
• 71B • Updated • 37
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M-GGUF
Text Generation
• 71B • Updated • 40
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L-GGUF
Text Generation
• 71B • Updated • 8
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_0-GGUF
Text Generation
• 71B • Updated • 10
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_S-GGUF
Text Generation
• 71B • Updated • 9
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M-GGUF
Text Generation
• 71B • Updated • 115
• 2
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_0-GGUF
Text Generation
• 71B • Updated • 3
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S-GGUF
Text Generation
• 71B • Updated • 1
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M-GGUF
Text Generation
• 71B • Updated • 16
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K-GGUF
Text Generation
• 71B • Updated • 435
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q8_0-GGUF
Text Generation
• 71B • Updated • 34
roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q2_K-GGUF
Text Generation
• 71B • Updated • 30
roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_S-GGUF
Text Generation
• 71B • Updated • 22
roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_M-GGUF
Text Generation
• 71B • Updated • 36
• 1
roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_L-GGUF
Text Generation
• 71B • Updated • 14