Jeremy Lam

whoisjeremylam's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in ubergarm/GLM-5.1-GGUF about 2 hours ago

render_message_to_json: Neither string content nor typed content is supported by the template. This is unexpected and may lead to issues.

3

#7 opened 3 days ago by

whoisjeremylam

New activity in HauhauCS/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive 21 days ago

Thanks. This is by far the best denial stripping I've ever seen.

👍 3

2

#30 opened 21 days ago by

phil111

New activity in unsloth/Qwen3.5-397B-A17B-GGUF about 2 months ago

Do the 397B quants need to be downloaded again?

➕ 1

2

#15 opened about 2 months ago by

whoisjeremylam

New activity in concavity-ai/superlinear-exp-v0.1 2 months ago

Q8 and smaller quants

3

#1 opened 2 months ago by

whoisjeremylam

New activity in ubergarm/Kimi-K2-Thinking-GGUF 4 months ago

smol-IQ2_KS also passes the official K2 Vendor Verifier test!

🔥 2

1

#15 opened 4 months ago by

whoisjeremylam

Output not respecting lines breaks?

12

#10 opened 5 months ago by

justj0sh

New activity in ubergarm/Kimi-K2-Instruct-GGUF 4 months ago

IQ2_KS passes the Moonshot K2 Vendor Verifier test

🔥 3

4

#8 opened 5 months ago by

whoisjeremylam

New activity in ubergarm/Kimi-K2-Instruct-0905-GGUF 6 months ago

IQ2_KS

79

#1 opened 8 months ago by

gghfez

New activity in cyankiwi/Qwen3-Omni-30B-A3B-Instruct-AWQ-4bit 6 months ago

Strange warning on first completion w/ vLLM 0.11.0

#6 opened 6 months ago by

whoisjeremylam

New activity in zai-org/GLM-4.6 6 months ago

How to stop reasoning?

3

#16 opened 6 months ago by

yuchenxie

New activity in cyankiwi/GLM-4.5V-AWQ-4bit 6 months ago

Best local VLM so far that I've found that fits in 96 GB of VRAM

#2 opened 6 months ago by

whoisjeremylam

New activity in INC4AI/GLM-4.6-gguf-q2ks-mixed-AutoRound 6 months ago

Model quality relative to other quantization techniques?

1

#1 opened 6 months ago by

spanspek

New activity in Intel/Ling-flash-2.0-gguf-q2ks-mixed-AutoRound 6 months ago

Inference with llama.cpp + Open WebUI gives repeating `?`

4

#1 opened 6 months ago by

whoisjeremylam

New activity in cerebras/Qwen3-Coder-REAP-25B-A3B 6 months ago

Aider Polyglot Benchmark

👍 1

1

#1 opened 6 months ago by

whoisjeremylam

New activity in Intel/Qwen3-Next-80B-A3B-Thinking-int4-AutoRound 7 months ago

Difference between int4-mixed and int4

1

#1 opened 7 months ago by

whoisjeremylam

New activity in ubergarm/DeepSeek-V3.1-GGUF 8 months ago

quant req: 256 GB RAM + 96 GB VRAM

👍 1

28

#1 opened 8 months ago by

whoisjeremylam

New activity in ubergarm/Kimi-K2-Instruct-GGUF 8 months ago

Neglible loss of PPL when using only 6 of 8 experts

🔥 2

3

#7 opened 8 months ago by

whoisjeremylam

New activity in unsloth/DeepSeek-V3-GGUF about 1 year ago

Dynamic quants

3

#13 opened about 1 year ago by

XelotX