inference-optimization/Qwen3-30B-from-self-speculators.eagle3-ckpt1
0.5B • Updated • 44
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/Qwen3-32B-from-self-speculators.eagle3-ckpt2
2B • Updated • 31
inference-optimization/Qwen3-32B-from-self-speculators.eagle3-ckpt1
2B • Updated • 36
inference-optimization/Qwen3-32B-from-self-speculators.eagle3-ckpt0
2B • Updated • 30
inference-optimization/Qwen3-30B-from-self-speculators.eagle3-ckpt0
0.5B • Updated • 32
inference-optimization/llama3_8b_sharegpt_5k
Updated
inference-optimization/Qwen3-30B-from-self-speculators.eagle3-ckpt2
0.5B • Updated • 35
inference-optimization/Qwen3-30B-from-self-speculators.eagle3-ckpt3
0.5B • Updated • 29
inference-optimization/Qwen3-30B-from-self-speculators.eagle3-ckpt4
0.5B • Updated • 25
inference-optimization/Qwen3-30B-from-Qwen3-235B_resps-speculators.eagle3-ckpt4
0.5B • Updated • 92
inference-optimization/Qwen3-30B-from-Qwen3-235B_resps-speculators.eagle3-ckpt5
0.5B • Updated • 142
inference-optimization/Qwen3-30B-from-Qwen3-235B_resps-speculators.eagle3-ckpt0
0.5B • Updated • 85
inference-optimization/Qwen3-Coder-Next.w8a8
Text Generation • 80B • Updated • 128
inference-optimization/gpt-oss-20b-from-gpt-oss-120b-ckpt3-speculator.eagle3
0.9B • Updated • 21
inference-optimization/Mistral-Small-4-119B-2603-BF16
119B • Updated • 220
inference-optimization/gpt-oss-20b-from-gpt-oss-120b-ckpt2-speculator.eagle3
0.9B • Updated • 97
inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch3
2B • Updated • 25
inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch2
2B • Updated • 12
inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch1
2B • Updated • 15
inference-optimization/gpt-oss-20b-from-gpt-oss-120b-ckpt1-speculator.eagle3
0.9B • Updated • 48
inference-optimization/gpt-oss-20b-from-gpt-oss-120b-ckpt0-speculator.eagle3
0.9B • Updated • 53
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-DDP8
5B • Updated • 14
inference-optimization/Qwen3-235B-A22B-Thinking-2507.w8a8
235B • Updated • 20
inference-optimization/Qwen3-235B-A22B-Instruct-2507.w8a8
235B • Updated • 13
inference-optimization/Qwen3-Next-80B-A3B-Instruct_mtp_speculator
Text Generation • 2B • Updated • 42
inference-optimization/Mistral3_speculator_dummy
2B • Updated • 28
inference-optimization/Phi-4-reasoning-vision-15B-FP8-dynamic
15B • Updated • 5
inference-optimization/Qwen3-235B-A22B-Thinking-2507.w4a16
32B • Updated • 13
inference-optimization/Qwen3-235B-A22B-Instruct-2507.w4a16
32B • Updated • 14
inference-optimization/Qwen3-32B-from-Qwen3-235B_resps-speculators.eagle3-ckpt0
2B • Updated • 83