NVFP4 is supported now please provide one.

#4
by shivshankar - opened

i tried gemma_3_12B_it_nvfp4_uncalibrated.safetensors,(it was probably created with comfy kitchen) and it worked.

https://huggingface.co/DreamFast/gemma-3-12b-it-heretic-v2 check out version 2 with vision support and nvfp4. I'll leave this thread open for others to read easier.

Tested okay for me here. Let me know how it goes!

Sign up or log in to comment