bg-digitalservices/Gemma-4-26B-A4B-it-NVFP4A16

Run on 3090

by faheemraza1 - opened 14 days ago

Hi, will I be able to run inference for this model using vLLM on an RTX 3090?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment