Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

ChibuUkachi updated a model about 6 hours ago

inference-optimization/MiniMax-M2.5.w4a16

ChibuUkachi published a model about 6 hours ago

inference-optimization/MiniMax-M2.5.w4a16

dsikka updated a model about 15 hours ago

inference-optimization/llama3-8b-sharegpt-5k-gen

View all activity

inference-optimization 's models 230

inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_hybrid

1B • Updated Mar 12 • 13

inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_heuristic

1B • Updated Mar 12 • 15

inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_hybrid

1B • Updated Mar 12 • 15

inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_heuristic

1B • Updated Mar 12 • 20

inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_heuristic

1B • Updated Mar 12 • 17

inference-optimization/Qwen3-8B_7_bits_mode_heuristic

7B • Updated Mar 12 • 15

inference-optimization/Qwen3-8B_7_bits_mode_noise

7B • Updated Mar 12 • 15

inference-optimization/Qwen3-8B_7_bits_mode_hybrid

7B • Updated Mar 12 • 15

inference-optimization/Qwen3-8B_6.5_bits_mode_heuristic

7B • Updated Mar 12 • 16

inference-optimization/Qwen3-8B_6.5_bits_mode_noise

7B • Updated Mar 12 • 18

inference-optimization/Qwen3-8B_6.5_bits_mode_hybrid

7B • Updated Mar 12 • 17

inference-optimization/Qwen3-8B_6_bits_mode_heuristic

7B • Updated Mar 12 • 14

inference-optimization/Qwen3-8B_6_bits_mode_noise

7B • Updated Mar 12 • 16

inference-optimization/Qwen3-8B_6_bits_mode_hybrid

7B • Updated Mar 12 • 63

inference-optimization/Qwen3-8B_5.5_bits_mode_heuristic

6B • Updated Mar 12 • 19

inference-optimization/Qwen3-8B_5.5_bits_mode_noise

6B • Updated Mar 12 • 17

inference-optimization/Qwen3-8B_5.5_bits_mode_hybrid

6B • Updated Mar 12 • 15

inference-optimization/Qwen3-8B_5_bits_mode_heuristic

6B • Updated Mar 12 • 15

inference-optimization/Qwen3-8B_5_bits_mode_noise

6B • Updated Mar 12 • 20

inference-optimization/Qwen3-8B_5_bits_mode_hybrid

6B • Updated Mar 12 • 20

inference-optimization/Llama-3.1-8B-Instruct_7_bits_mode_heuristic

7B • Updated Mar 12 • 11

inference-optimization/Llama-3.1-8B-Instruct_7_bits_mode_noise

7B • Updated Mar 12 • 11

inference-optimization/Llama-3.1-8B-Instruct_7_bits_mode_hybrid

7B • Updated Mar 12 • 18

inference-optimization/Llama-3.1-8B-Instruct_6.5_bits_mode_heuristic

7B • Updated Mar 12 • 27

inference-optimization/Llama-3.1-8B-Instruct_6.5_bits_mode_noise

7B • Updated Mar 12 • 12

inference-optimization/Llama-3.1-8B-Instruct_6.5_bits_mode_hybrid

7B • Updated Mar 12 • 14

inference-optimization/Llama-3.1-8B-Instruct_6_bits_mode_heuristic

6B • Updated Mar 12 • 15

inference-optimization/Llama-3.1-8B-Instruct_6_bits_mode_noise

6B • Updated Mar 12 • 13

inference-optimization/Llama-3.1-8B-Instruct_6_bits_mode_hybrid

6B • Updated Mar 12 • 13

inference-optimization/Llama-3.1-8B-Instruct_5.5_bits_mode_heuristic

6B • Updated Mar 12 • 10