| --- |
| license: apache-2.0 |
| pipeline_tag: image-text-to-text |
| language: |
| - en |
| base_model: |
| - prithivMLmods/Qwen2-VL-OCR-2B-Instruct |
| library_name: peft |
| tags: |
| - ocr_test |
| - qwen |
| - qvq |
| - kie |
| - trl |
| - text-generation-inference |
| - qwen2_vl |
| --- |
| # **QvQ KiE [Key Information Extractor] Adapter for Qwen2-VL-OCR-2B-Instruct** |
|
|
| The **QvQ KiE adapter** is a fine-tuned version of the **Qwen/Qwen2-VL-2B-Instruct** model, specifically tailored for tasks involving **Optical Character Recognition (OCR)**, **image-to-text conversion**, and **math problem-solving** with **LaTeX formatting**. This adapter enhances the model’s performance for multi-modal tasks by integrating vision and language capabilities in a conversational framework. |
|
|
| # **Key Features** |
|
|
| ### 1. **Vision-Language Integration** |
| - Seamlessly combines **image understanding** with **natural language processing**, enabling accurate image-to-text conversion. |
| |
| ### 2. **Optical Character Recognition (OCR)** |
| - Extracts and processes textual content from images with high precision, making it ideal for document analysis and information extraction. |
|
|
| ### 3. **Math and LaTeX Support** |
| - Efficiently handles complex **math problem-solving**, outputting results in **LaTeX format** for easy integration into scientific and academic workflows. |
|
|
| ### 4. **Conversational Capabilities** |
| - Equipped with multi-turn conversational capabilities, providing context-aware responses during interactions. This makes it suitable for tasks requiring ongoing dialogue and clarification. |
|
|
| ### 5. **Image-Text-to-Text Generation** |
| - Supports input in various forms: |
| - **Images** |
| - **Text** |
| - **Image + Text (multi-modal)** |
| - Outputs include descriptive or problem-solving text, depending on the input type. |
|
|
| ### 6. **Secure Weight Format** |
| - Utilizes **Safetensors** for fast and secure model weight loading, ensuring both performance and safety during deployment. |
|
|
| --- |
