Ryzen-AI-1.7-Hybrid-LLM
Collection
42 items • Updated • 5
amd/gemma-2-2b-onnx-ryzenai-1.7-hybrid
Introduction
This model was created using Quark Quantization, followed by OGA Model Builder, and finalized with post-processing for NPU deployment.
Quantization Strategy
- AWQ / Group 128 / Asymmetric / BFP16 activations / UINT4 weights
Quick Start
For quickstart, refer to Ryzen AI documentation
Evaluation scores
The MMLU scores are, astronomy: 53.29, philosophy: 56.91 and management: 68.93.
License
Modifications copyright(c) 2026 Advanced Micro Devices,Inc. All rights reserved.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for amd/gemma-2-2b-onnx-ryzenai-1.7-hybrid
Base model
google/gemma-2-2b