Models

172

Full-text search

Active filters: kv-cache-quantization

majentik/gemma-4-E4B-turboquant

Image-Text-to-Text • 8B • Updated about 21 hours ago • 209 • 6

majentik/Qwen3.5-27B-RotorQuant

Updated 1 day ago • 1

majentik/gemma-4-31B-TurboQuant-MLX-8bit

Image-Text-to-Text • 9B • Updated about 21 hours ago • 1

majentik/gemma-4-31B-RotorQuant-GGUF-Q8_0

31B • Updated about 16 hours ago • 1

majentik/gemma-4-31B-it-RotorQuant-GGUF-Q8_0

31B • Updated about 16 hours ago • 1

majentik/Qwen3.5-27B-RotorQuant-GGUF-Q2_K

27B • Updated about 15 hours ago • 1

rungalileo/llama-3.2-3B-instruct-trtllm-ckpt-wq_int4_awq-kv_int8

Text Generation • Updated Feb 8 • 5

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_int4_awq-kv_int8

Text Generation • Updated Feb 8 • 7

rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_fp8-kv_fp8

Text Generation • Updated 28 days ago • 30

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_fp8-kv_fp8

Text Generation • Updated 28 days ago • 19

rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_fp8-kv_fp8

Text Generation • Updated 6 days ago • 43

rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8

Text Generation • Updated 28 days ago • 14

rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8

Text Generation • Updated 28 days ago • 11

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_nvfp4-kv_fp8

Text Generation • Updated 28 days ago • 17

rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_w8a8sq-kv_int8

Text Generation • Updated 12 days ago • 18

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_w8a8sq-kv_int8

Text Generation • Updated 12 days ago • 15

majentik/gemma-4-E4B-rotorquant

Image-Text-to-Text • Updated about 21 hours ago

majentik/MERaLiON-3-10B-RotorQuant

Updated 1 day ago

majentik/MERaLiON-2-10B-RotorQuant

Translation • Updated 1 day ago

majentik/MERaLiON-2-3B-RotorQuant

Translation • Updated 1 day ago

majentik/Qwen3.5-27B-TurboQuant

Updated 1 day ago

majentik/Qwen3.5-27B-TurboQuant-MLX-4bit

27B • Updated 1 day ago • 18

majentik/Qwen3.5-27B-TurboQuant-MLX-8bit

27B • Updated 1 day ago • 19

majentik/Qwen3.5-27B-RotorQuant-MLX-4bit

27B • Updated 1 day ago • 18

majentik/Qwen3.5-27B-RotorQuant-MLX-8bit

27B • Updated 1 day ago • 16

majentik/Mistral-Small-4-119B-TurboQuant

Text Generation • Updated 1 day ago

majentik/Mistral-Small-4-119B-RotorQuant

Text Generation • Updated 1 day ago

majentik/Leanstral-TurboQuant

Updated 1 day ago

majentik/Leanstral-RotorQuant

Updated 1 day ago

majentik/DeepSeek-V3.2-TurboQuant

Text Generation • Updated 1 day ago