AttributeError: 'CompressedLinear' object has no attribute 'weight'

#1
by Hadbeen123 - opened

image.png

IST Austria Distributed Algorithms and Systems Lab org

@Hadbeen123 Hi, which version of vLLM/compressed tensors are you using?

Sign up or log in to comment