Only generates nulls for me
#2
by catplusplus - opened
VLLM 0.18.0, NVIDIA Thor dev kit. Any KIs/worarounds?
Same here,
Since a couple of days I've got only 404 errors on 'v1/chat/completions'
v1/models returns a valid response.
Could it be a problem with an update?
This model seems to work on my Thor: https://huggingface.co/catplusplus/MiniMax-M2.5-REAP-172B-A10B-NVFP4