Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

ChibuUkachi updated a model about 6 hours ago

inference-optimization/MiniMax-M2.5.w4a16

ChibuUkachi published a model about 6 hours ago

inference-optimization/MiniMax-M2.5.w4a16

dsikka updated a model about 15 hours ago

inference-optimization/llama3-8b-sharegpt-5k-gen

View all activity

inference-optimization 's models 230

inference-optimization/gpt-oss-120b-from-qwen235b-ckpt5-speculator.eagle3

0.9B • Updated 29 days ago • 98

inference-optimization/gpt-oss-120b-from-qwen235b-ckpt4-speculator.eagle3

0.9B • Updated 30 days ago • 70

inference-optimization/gpt-oss-120b-ckpt4-speculator.eagle3

0.9B • Updated Mar 12 • 4

inference-optimization/gpt-oss-120b-ckpt3-speculator.eagle3

0.9B • Updated Mar 12 • 6

inference-optimization/Qwen3-Coder-Next.w4a16

Text Generation • 12B • Updated Mar 12 • 80

inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_heuristic

3B • Updated Mar 12 • 11

inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_noise

3B • Updated Mar 12 • 11

inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_hybrid

3B • Updated Mar 12 • 13

inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_heuristic

3B • Updated Mar 12 • 12

inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_noise

3B • Updated Mar 12 • 13

inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_hybrid

3B • Updated Mar 12 • 12

inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_heuristic

3B • Updated Mar 12 • 13

inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_noise

3B • Updated Mar 12 • 13

inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_hybrid

3B • Updated Mar 12 • 12

inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_heuristic

3B • Updated Mar 12 • 13

inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_noise

3B • Updated Mar 12 • 15

inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_hybrid

3B • Updated Mar 12 • 14

inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_heuristic

3B • Updated Mar 12 • 13

inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_noise

3B • Updated Mar 12 • 14

inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_hybrid

3B • Updated Mar 12 • 12

inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_noise

1B • Updated Mar 12 • 15

inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_noise

1B • Updated Mar 12 • 14

inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_hybrid

1B • Updated Mar 12 • 18

inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_noise

1B • Updated Mar 12 • 14

inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_hybrid

1B • Updated Mar 12 • 16

inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_heuristic

1B • Updated Mar 12 • 14

inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_noise

1B • Updated Mar 12 • 19

inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_hybrid

1B • Updated Mar 12 • 14

inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_heuristic

1B • Updated Mar 12 • 14

inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_noise

1B • Updated Mar 12 • 13