Hugging Face's logo

yeirr
/
llama3-8b-dolphin-v2.9.1-awq-g128-4bit

Text Generation
Transformers
Safetensors
English
llama
conversational
text-generation-inference
4-bit precision
awq
Model card Files
xet
 Community

Introduction

A quantized version of base model.

Downloads last month
3
Safetensors
Model size
8B params
Tensor type
I32
·
F16
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for yeirr/llama3-8b-dolphin-v2.9.1-awq-g128-4bit

Base model

meta-llama/Meta-Llama-3-8B
Quantized
(273)
this model