dimitribarbot/CodeLlama-13B-Instruct-GPTQ-TensorRT-LLM-RTX-4090 Text Generation • Updated Oct 25, 2024 • 18 • 1
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_int4_awq-kv_int8 Text Generation • Updated Feb 8 • 7
Alexzander85/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-NVFP4-MLP-FP8KV Text Generation • 8B • Updated Mar 4 • 1.69k • 9
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_fp8-kv_fp8 Text Generation • Updated 30 days ago • 18
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_fp8-kv_fp8 Text Generation • Updated 30 days ago • 7
rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8 Text Generation • Updated 30 days ago • 5
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8 Text Generation • Updated 30 days ago • 6
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_nvfp4-kv_fp8 Text Generation • Updated 30 days ago • 4
Shoolife/Qwen2.5-1.5B-Instruct-TensorRT-LLM-Checkpoint-FP16 Text Generation • Updated 17 days ago • 869
Shoolife/Qwen2.5-1.5B-Instruct-TensorRT-LLM-Checkpoint-FP8 Text Generation • Updated 17 days ago • 105
Shoolife/Qwen2.5-1.5B-Instruct-TensorRT-LLM-Checkpoint-NVFP4 Text Generation • Updated 17 days ago • 512
Shoolife/Phi-4-mini-instruct-TensorRT-LLM-Checkpoint-NVFP4 Text Generation • Updated 20 days ago • 41
Shoolife/Qwen2.5-1.5B-Instruct-TensorRT-LLM-Checkpoint-BF16 Text Generation • Updated 17 days ago • 117