Hugging Face's logo

ssbuild
/
xverse-13b-int4

Text Generation
Transformers
PyTorch
xverse
custom_code
Model card Files
xet
 Community
2

webui报错error-使用oobabooga时候

#1
by songzhen - opened
Discussion
songzhen

RuntimeError: mat1 and mat2 shapes cannot be multiplied (110x5120 and 2560x5120)
ssbuild
 Owner

RuntimeError: mat1 and mat2 shapes cannot be multiplied (110x5120 and 2560x5120)

推理demo https://github.com/ssbuild/xverse_finetuning/blob/dev/infer.py
ssbuild
 Owner

效果https://github.com/ssbuild/xverse_finetuning/blob/dev/asserts/1.png

songzhen changed discussion status to closed

Sign up or log in to comment