宋小猫

SongXiaoMao's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in z-lab/Qwen3.5-27B-DFlash 2 days ago

FP8 work for base model or is 16-bit of 27B required?

14

#2 opened 16 days ago by

unoid

liked 2 models 3 days ago

Qwen/Qwen3.5-27B-FP8

Image-Text-to-Text • 28B • Updated Feb 26 • 848k • 127

Qwen/Qwen3.5-122B-A10B-GPTQ-Int4

Image-Text-to-Text • 125B • Updated Mar 3 • 279k • 36

New activity in Jackrong/Qwopus3.5-27B-v3 12 days ago

Is there anyone who can tell me how to run this model with vllm correctly?

😔 3

7

#8 opened 14 days ago by

beginor

New activity in olka-fi/Qwen3.5-27B-MXFP4 15 days ago

Can the big guy quantify this model into MXFP4? Thank you!!

#3 opened 15 days ago by

SongXiaoMao

New activity in Jackrong/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled 15 days ago

How does the VLLM start this model?

2

#4 opened 30 days ago by

SongXiaoMao

New activity in olka-fi/Qwen3.5-122B-A10B-MXFP4 17 days ago

This quantization model is amzing

👍❤️ 2

5

#1 opened about 1 month ago by

hyunw55

New activity in olka-fi/Qwen3.5-27B-MXFP4 18 days ago

Why is the file size of 4bit similar to FP8?

3

#2 opened 18 days ago by

SongXiaoMao

liked 2 models 18 days ago

olka-fi/Qwen3.5-35B-A3B-MXFP4

Image-Text-to-Text • 20B • Updated Mar 15 • 256 • 2

olka-fi/Qwen3.5-122B-A10B-MXFP4

Text Generation • 71B • Updated Feb 25 • 3.68k • 9

New activity in edp1096/Huihui-Qwen3.5-27B-abliterated-FP8 18 days ago

Sensitive information is not a question

2

#3 opened 20 days ago by

SongXiaoMao

New activity in win10/Huihui-Qwen3.5-27B-abliterated-FP8 20 days ago

VLLM 0.18.0 runs with an error

#2 opened 20 days ago by

SongXiaoMao

New activity in groxaxo/Huihui-Qwen3.5-27B-W8A8-INT8 23 days ago

I get an error using vllm0.18.0

1

#1 opened 23 days ago by

SongXiaoMao

New activity in huihui-ai/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated 28 days ago

使用VLLM启动会报错

#3 opened 28 days ago by

SongXiaoMao

liked a model 29 days ago

Qwen/Qwen3.5-27B

Image-Text-to-Text • 28B • Updated Feb 25 • 3.19M • • 929

New activity in Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled 30 days ago

Tokenizer class TokenizersBackend does not exist in vllm v0.17.1

12

#26 opened about 1 month ago by

putcn

liked a model about 1 month ago

olka-fi/Qwen3.5-27B-MXFP4

Image-Text-to-Text • 20B • Updated Mar 2 • 147 • 2

New activity in huihui-ai/Huihui-Qwen3.5-122B-A10B-abliterated-GGUF about 1 month ago

Can you make a quantitative model? Qwen3.5-122B-A10B-GPTQ-Int4

#2 opened about 1 month ago by

SongXiaoMao

liked a model about 1 month ago

huihui-ai/Huihui-Qwen3.5-27B-abliterated

Image-Text-to-Text • 28B • Updated Mar 2 • 169k • 114

liked a model 2 months ago

zai-org/GLM-4.7-Flash

Text Generation • 31B • Updated Jan 29 • 729k • • 1.67k