Edit Models filters

Model Tree

meta-llama/Llama-3.1-8B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

408

Full-text search

Active filters: llama.cpp, meta-llama/Llama-3.1-8B-Instruct

bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Dec 1, 2024 • 246k • 348

unsloth/Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated May 9, 2025 • 9.91k • 36

ia-espirita/andre-luiz-ai

Text Generation • 8B • Updated 6 days ago • 43 • 2

YorkieOH10/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 262 • 9

DevQuasar-4/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Dec 4, 2024 • 60 • 2

leafspark/Meta-Llama-3.1-8B-Instruct-Q2_K-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 22

legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 326 • 6

brittlewis12/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 412 • 2

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 152k • 34

lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 28, 2024 • 102k • 256

Ren6767/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 2

mtsdurica/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 55

SanctumAI/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Sep 11, 2024 • 21.7k • 18

backyardai/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 193 • 1

HeRksTAn/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 12

xyottax/Meta-Llama-3.1-8B-Instruct-Q3_K_S-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 36

rumbleFTW/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 11 • 1

Ayylex/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 5 • 1

3Simplex/Meta-Llama-3.1-8B-Instruct-gguf

Text Generation • 8B • Updated Jul 27, 2024 • 98 • 2

Kondara/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 31

MugenYume/Meta-Llama-3.1-8B-Instruct-Q4_K_S-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 34

ddarolf/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 3

starble-dev/Meta-Llama-3.1-8B-Instruct-GGUF

8B • Updated Jul 24, 2024 • 69

kowlick/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 1

gaianet/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Feb 8, 2025 • 5.16k

shenzhi-wang/Llama3.1-8B-Chinese-Chat

Text Generation • 8B • Updated Jul 29, 2024 • 7.67k • • 264

adrlau/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 49

Pranav102999/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 12

joshnader/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 7.99k • 2

joshnader/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 18 • 1