Hugging Face's logo

baidu
/
ERNIE-4.5-VL-28B-A3B-Thinking

Image-Text-to-Text
Transformers
Safetensors
English
Chinese
ernie4_5_moe_vl
ERNIE4.5
conversational
custom_code
Model card Files
xet
 Community
13

Request for AWQ 4 bit version, please!

#3
by asandeistefan - opened
Discussion
asandeistefan

I'd love to be able to locally use this model with my 24gb GPU.
asandeistefan

solved: https://huggingface.co/cyankiwi/ERNIE-4.5-VL-28B-A3B-Thinking-AWQ-4bit

Thank you!

asandeistefan changed discussion status to closed

Sign up or log in to comment