fp8 please

#1
by huang123chuan - opened

fp8 please.
I want to deploy by vllm

Sign up or log in to comment