Firworks/Cosmos-Reason2-8B-nvfp4 on spark
#1
by ascendit-libertas - opened
I'd like to try it on spark nvfp4! :)
I think if you swap out vllm/vllm-openai:nightly for the latest Nvidia spark specific vllm image it probably should work? I unfortunately don't have a Spark or any GB10 system to try it on.