roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_0-GGUF
Text Generation • 71B • Updated • 1
Edit Models filters
Apps
Inference Providers
Active filters: meta-llama/Llama-3.1-70B-Instruct
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S-GGUF
Text Generation • 71B • Updated
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M-GGUF
Text Generation • 71B • Updated • 10
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K-GGUF
Text Generation • 71B • Updated • 442
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q8_0-GGUF
Text Generation • 71B • Updated • 34
tensorblock/Llama-3.1-70B-Instruct-GGUF
Text Generation • 71B • Updated • 20
context-labs/neuralmagic-llama-3.1-70b-instruct-FP8
Text Generation • 71B • Updated • 7
necva/replicate-IEPile-Llama3.1-70B
73B • Updated • 1
necva/replica-IEPile-Llama3.1-70B
73B • Updated • 3
turboderp/Llama-3.1-70B-Instruct-exl3
Updated • 33 • 1
jusjinuk/Llama-3.1-70B-Instruct-2bit-GuidedQuant-QTIP
11B • Updated • 3
jusjinuk/Llama-3.1-70B-Instruct-3bit-GuidedQuant-QTIP
15B • Updated • 2
jusjinuk/Llama-3.1-70B-Instruct-4bit-GuidedQuant-QTIP
19B • Updated • 1
RedHatAI/Llama-3.1-70B-Instruct-NVFP4
Text Generation • 41B • Updated • 277
RedHatAI/Llama-3.1-70B-Instruct-NVFP4A16
Text Generation • 41B • Updated • 9
Hyun9junn/Llama-3.1-70B-Instruct-W4A4KV4-FlatQuant
36B • Updated • 3
TevunahAi/Llama-3.1-70B-Instruct-Ultra-Hybrid
Text Generation • 22B • Updated • 5
sh0ck0r/llama-3.1-70b-instruct-FP8-Dynamic
Text Generation • 71B • Updated • 3
cyborgwittgenstein/cassie-70b-v6-gguf
71B • Updated
JongYeop/Llama-3.1-70B-Instruct-NVFP4-W4A4
41B • Updated • 119
JongYeop/Llama-3.1-70B-Instruct-MXFP4-W4A4
Text Generation • 38B • Updated • 157
forkjoin-ai/llama-3.1-70b-instruct-gguf
Text Generation • 71B • Updated • 40
baa-ai/Llama-3.1-70B-Instruct-SWAN-5bit-MLX
71B • Updated • 470