protoLabsAI
/

gemma-4-31B-it-FP8

Text Generation

image-text-to-text

Model card Files Files and versions

vllm KeyError: 'layers.0.mlp.down_proj.weight_scale'

#1

by huang123chuan - opened 16 days ago

nighy version
pip install -U transformer

I can confirm this error, even with nightly transformers version

same error, after nightly vllm and >5.0 transformer installed, this error persist

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment