RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 Text Generation • 19B • Updated Oct 9, 2024 • 76 • 5
RedHatAI/Phi-3-medium-128k-instruct-quantized.w4a16 Text Generation • 2B • Updated Oct 9, 2024 • 1.19k • 3
RedHatAI/Phi-3-mini-128k-instruct-quantized.w4a16 Text Generation • 0.7B • Updated Oct 9, 2024 • 18 • 1
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w8a8 Text Generation • 8B • Updated Oct 9, 2024 • 667 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a8 Text Generation • 14B • Updated Oct 9, 2024 • 24 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a16 Text Generation • 4B • Updated Oct 9, 2024 • 14 • 2