Human-Like-Qwen2.5-7B-Instruct-AWQ
Model Description
This is the 4-bit INT4 AWQ quantized version of HumanLLMs/Human-Like-Qwen2.5-7B-Instruct.
Quantization Details
- Format: INT4 AWQ
- W_bit: 4
- Group Size: 128
- Zero Point: True
- Version: GEMM
- Downloads last month
- 2
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support
Model tree for swzzzzc/Human-Like-Qwen2.5-7B-Instruct-AWQ
Base model
Qwen/Qwen2.5-7B Finetuned
Qwen/Qwen2.5-7B-Instruct Finetuned
HumanLLMs/Human-Like-Qwen2.5-7B-Instruct