@Hadbeen123 Hi, which version of vLLM/compressed tensors are you using?
· Sign up or log in to comment