01-ai
/

Yi-1.5-34B-Chat-16K

Text Generation

text-generation-inference

Model card Files Files and versions

会出量化版本吗?

#3

by william0014 - opened Jun 6, 2024

请问你们会出AWQ或者GPTQ-INT4版本吗?

01-ai org Jun 12, 2024

你好，魔搭已经提供啦，可以在这里找到 https://www.modelscope.cn/models/AI-ModelScope/Yi-1.5-34B-Chat-GPTQ/summary

lorinma changed discussion status to closed Jun 12, 2024

16k的这里也有 https://modelscope.cn/models/tclf90/Yi-1.5-34B-Chat-16K-GPTQ-Int4/summary

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment