rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_w8a8sq-kv_int8 Text Generation • Updated 12 days ago • 15
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_w8a8sq-kv_int8 Text Generation • Updated 12 days ago • 18
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8 Text Generation • Updated 28 days ago • 11
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_nvfp4-kv_fp8 Text Generation • Updated 28 days ago • 17
rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8 Text Generation • Updated 28 days ago • 14
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_fp8-kv_fp8 Text Generation • Updated 28 days ago • 30
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_fp8-kv_fp8 Text Generation • Updated 28 days ago • 19
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_int4_awq-kv_int8 Text Generation • Updated Feb 8 • 7
rungalileo/xlm-roberta-base-misogyny-sexism-tweets-quantized-traced Text Classification • Updated Dec 14, 2023 • 12