relaxml/Llama-2-13b-chat-QTIP-2Bit
2B • Updated • 12
relaxml/Llama-2-7b-chat-QTIP-2Bit
1B • Updated • 26
• 1
relaxml/Llama-3.1-405B-Instruct-QTIP-4Bit
105B • Updated • 3
relaxml/Llama-3.1-405B-Instruct-QTIP-3Bit
80B • Updated • 1
• 1
relaxml/Llama-2-7b-QTIP-4Bit
2B • Updated • 10
• 2
relaxml/Llama-2-7b-QTIP-3Bit
1B • Updated • 137
• 1
relaxml/Llama-2-13b-QTIP-3Bit
3B • Updated • 174
relaxml/Llama-2-70b-QTIP-3Bit
13B • Updated • 4
• 1
relaxml/Llama-2-13b-QTIP-4Bit
4B • Updated • 1
relaxml/Llama-2-70b-QTIP-4Bit
18B • Updated • 1
relaxml/Llama-2-70b-QTIP-2Bit
9B • Updated relaxml/Llama-2-13b-QTIP-2Bit
2B • Updated • 2
relaxml/Llama-3.1-8b-Instruct-QTIP-4Bit
3B • Updated • 27
• 2
relaxml/Llama-3.1-8b-Instruct-QTIP-3Bit
2B • Updated • 9
relaxml/Llama-2-70b-chat-E8PRVQ-4Bit
Text Generation
• 5B • Updated • 3
relaxml/Llama-2-13b-chat-E8PRVQ-4Bit
Text Generation
• 1B • Updated • 3
relaxml/Llama-2-7b-chat-E8PRVQ-4Bit
Text Generation
• 0.7B • Updated • 38
relaxml/Llama-2-70b-E8PRVQ-4Bit
Text Generation
• 5B • Updated • 6
relaxml/Llama-2-13b-E8PRVQ-4Bit
Text Generation
• 1B • Updated • 7
relaxml/Llama-2-7b-E8PRVQ-4Bit
Text Generation
• 0.7B • Updated • 12
relaxml/Llama-2-70b-chat-E8PRVQ-3Bit
Text Generation
• 4B • Updated • 1
relaxml/Llama-2-13b-chat-E8PRVQ-3Bit
Text Generation
• 0.9B • Updated • 5
relaxml/Llama-2-7b-chat-E8PRVQ-3Bit
Text Generation
• 0.6B • Updated • 17
relaxml/Llama-2-70b-E8PRVQ-3Bit
Text Generation
• 4B • Updated • 9
relaxml/Llama-2-13b-E8PRVQ-3Bit
Text Generation
• 0.9B • Updated • 6
relaxml/Llama-2-7b-E8PRVQ-3Bit
Text Generation
• 0.6B • Updated • 5
relaxml/Llama-2-70b-chat-E8P-2Bit
Text Generation
• 3B • Updated • 10
• 6
relaxml/Llama-2-13b-chat-E8P-2Bit
Text Generation
• 0.7B • Updated • 28
• 1
relaxml/Llama-2-7b-chat-E8P-2Bit
Text Generation
• 0.5B • Updated • 67
• 2
relaxml/Llama-2-70b-E8P-2Bit
Text Generation
• 3B • Updated • 8
• 3