Oleg Kibirev

catplusplus's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in llmfan46/gemma-4-31B-it-uncensored-heretic about 21 hours ago

Would you consider model adoption to solve your storage issues?

1

#2 opened about 21 hours ago by

catplusplus

New activity in coder3101/Qwen3.5-122B-A10B-heretic-v2 1 day ago

quantizing to MLX 4bit removed abliteration

9

#2 opened about 1 month ago by

giediprime

do the same thing you did with 27b because it does a lot better.

1

#3 opened 28 days ago by

drmcbride

New activity in coder3101/Qwen3.5-122B-A10B-heretic-v2 4 days ago

Uploaded an NVFP4 quant for Thor/Spark

#5 opened 4 days ago by

catplusplus

New activity in saricles/MiniMax-M2.5-REAP-172B-A10B-NVFP4-GB10 9 days ago

Only generates nulls for me

2

#2 opened 14 days ago by

catplusplus

New activity in tacos4me/Step-3.5-Flash-NVFP4 14 days ago

Generates incoherent outputs for me with VLLM 0.18

1

#5 opened 14 days ago by

catplusplus

New activity in nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 22 days ago

VLLM + MTP + NVFP4 doesn't work

👀 1

2

#16 opened 22 days ago by

catplusplus

New activity in nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 27 days ago

Run on DGX Spark

16

#14 opened 29 days ago by

LimeemiL

New activity in nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 28 days ago

Doesn't work with latest vllm, even tried to recompile vLLM and transformers from git

➕ 1

4

#8 opened about 1 month ago by

catplusplus

New activity in nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 29 days ago

All this talk about NVFP4 - why is it dog slow?

14

#13 opened about 1 month ago by

josephbreda

New activity in nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 about 1 month ago

NVFP4 cannot be loaded in SGLang

4

#12 opened about 1 month ago by

mratsim

vLLM MTP unusable on RTX 6000 Pro, as spec decoding consumes 20GB+ VRAM at start-up, causing OOM

5

#9 opened about 1 month ago by

lsmc

New activity in llmfan46/Qwen3.5-35B-A3B-ultra-uncensored-heretic about 1 month ago

Made NVFP4 version

#3 opened about 1 month ago by

catplusplus

Got better even though the higher KLD!

👍 4

3

#2 opened about 1 month ago by

FORNAX20

New activity in llmfan46/Qwen3.5-35B-A3B-uncensored-heretic about 1 month ago

Any revision plan?

6

#2 opened about 1 month ago by

Lck0427

Made catplusplus/Qwen3.5-35B-A3B-heretic-NVFP4 for Blackwell users

1

#3 opened about 1 month ago by

catplusplus

Made catplusplus/Qwen3.5-35B-A3B-heretic-NVFP4 for Blackwell users

1

#3 opened about 1 month ago by

catplusplus

Any revision plan?

6

#2 opened about 1 month ago by

Lck0427