any AWQ quantized model ??

#29

by crystech - opened Feb 19

Feb 19

any AWQ quantized model soon ???

Feb 19

Hi @crystech , any AWQ quantized model available for testing? Thanks!

Feb 21

would be also interested in this

Feb 25

Interested for awq quantized version, with 2xh200 I cant deploy it. Only NVFP4 version but not working with hooper nvidia gpu.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment