Image-Text-to-Text
Transformers
Safetensors
Korean
English
qwen3_5
korean
reasoning
multimodal
mix
conversational
Instructions to use ginigen-ai/Rogue-28B-MIX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ginigen-ai/Rogue-28B-MIX with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="ginigen-ai/Rogue-28B-MIX") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("ginigen-ai/Rogue-28B-MIX") model = AutoModelForImageTextToText.from_pretrained("ginigen-ai/Rogue-28B-MIX") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use ginigen-ai/Rogue-28B-MIX with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "ginigen-ai/Rogue-28B-MIX" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ginigen-ai/Rogue-28B-MIX", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/ginigen-ai/Rogue-28B-MIX
- SGLang
How to use ginigen-ai/Rogue-28B-MIX with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "ginigen-ai/Rogue-28B-MIX" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ginigen-ai/Rogue-28B-MIX", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "ginigen-ai/Rogue-28B-MIX" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ginigen-ai/Rogue-28B-MIX", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use ginigen-ai/Rogue-28B-MIX with Docker Model Runner:
docker model run hf.co/ginigen-ai/Rogue-28B-MIX
update lineage: father is Darwin-28B-Opus
Browse files
README.md
CHANGED
|
@@ -13,7 +13,7 @@ tags:
|
|
| 13 |
- merge
|
| 14 |
- darwin-family
|
| 15 |
base_model:
|
| 16 |
-
-
|
| 17 |
- NewenAI/QuettaLLMs-27B-Koreasoner-V3
|
| 18 |
---
|
| 19 |
|
|
@@ -37,9 +37,9 @@ base_model:
|
|
| 37 |
▼
|
| 38 |
┌────────── 친할머니 (Father's Mother) ────────────┐
|
| 39 |
│ │
|
| 40 |
-
│
|
| 41 |
-
│ -
|
| 42 |
-
│ -
|
| 43 |
│ │
|
| 44 |
└───────────────────────────────────────────────────┘
|
| 45 |
│
|
|
@@ -47,10 +47,11 @@ base_model:
|
|
| 47 |
┌──────────────────────────────────────────────────────────────────────────────┐
|
| 48 |
│ 아버지 (Father) │
|
| 49 |
│ │
|
| 50 |
-
│
|
| 51 |
-
│ -
|
|
|
|
|
|
|
| 52 |
│ - <think> 트레이스로 단계별 사고 │
|
| 53 |
-
│ - 추론·코딩·수학 강점 │
|
| 54 |
│ │
|
| 55 |
└──────────────────────────────────────────────────────────────────────────────┘
|
| 56 |
|
|
@@ -92,7 +93,7 @@ base_model:
|
|
| 92 |
║ ginigen-ai/Rogue-28B-MIX (Apache 2.0, Private) ║
|
| 93 |
║ ║
|
| 94 |
║ ✦ 조상의 능력 모두 계승 ║
|
| 95 |
-
║ - 친가 → 추론·생각 트레이스 (
|
| 96 |
║ - 외가 → 한국어·K-AI 도메인 지식 (Quetta) ║
|
| 97 |
║ ║
|
| 98 |
║ ✦ Smart MRI Streaming Merge ║
|
|
@@ -112,21 +113,21 @@ base_model:
|
|
| 112 |
|
| 113 |
## 📊 평가 (한국어 공개 10 데이터셋, 100문제 × 1 seed, temperature=0)
|
| 114 |
|
| 115 |
-
| Dataset |
|
| 116 |
-
|---|---:|---:|
|
| 117 |
-
| CLIcK |
|
| 118 |
-
| KMMLU History |
|
| 119 |
-
| KMMLU Law |
|
| 120 |
-
| KMMLU Health |
|
| 121 |
-
| HAERAE General |
|
| 122 |
-
| HAERAE History |
|
| 123 |
-
| HAERAE Linguistics |
|
| 124 |
-
| KoBEST Hellaswag |
|
| 125 |
-
| KoBEST COPA |
|
| 126 |
-
| KoBEST BoolQ |
|
| 127 |
-
| **Macro Avg** |
|
| 128 |
-
|
| 129 |
-
|
| 130 |
|
| 131 |
---
|
| 132 |
|
|
@@ -178,14 +179,14 @@ print(tokenizer.decode(out[0], skip_special_tokens=False))
|
|
| 178 |
|
| 179 |
## 📜 라이선스
|
| 180 |
|
| 181 |
-
Apache 2.0 — 상업적 사용 가능. 두 부모
|
| 182 |
|
| 183 |
---
|
| 184 |
|
| 185 |
## 🤝 출처
|
| 186 |
|
| 187 |
-
- 친아빠: https://huggingface.co/
|
| 188 |
- 엄마: https://huggingface.co/NewenAI/QuettaLLMs-27B-Koreasoner-V3
|
| 189 |
- 친할아버지/외할아버지: https://huggingface.co/unsloth (Qwen 3.5/3.6 멀티모달)
|
| 190 |
-
- 친할머니:
|
| 191 |
- 외할머니: K-AI Korean Leaderboard ecosystem
|
|
|
|
| 13 |
- merge
|
| 14 |
- darwin-family
|
| 15 |
base_model:
|
| 16 |
+
- FINAL-Bench/Darwin-28B-Opus
|
| 17 |
- NewenAI/QuettaLLMs-27B-Koreasoner-V3
|
| 18 |
---
|
| 19 |
|
|
|
|
| 37 |
▼
|
| 38 |
┌────────── 친할머니 (Father's Mother) ────────────┐
|
| 39 |
│ │
|
| 40 |
+
│ 한국어 도메인 특화 가족원 │
|
| 41 |
+
│ - 한국어 표현·지식 강화 출처 │
|
| 42 |
+
│ - Darwin family (한국어 토크나이저 호환) │
|
| 43 |
│ │
|
| 44 |
└───────────────────────────────────────────────────┘
|
| 45 |
│
|
|
|
|
| 47 |
┌──────────────────────────────────────────────────────────────────────────────┐
|
| 48 |
│ 아버지 (Father) │
|
| 49 |
│ │
|
| 50 |
+
│ FINAL-Bench/Darwin-28B-Opus (Apache 2.0) │
|
| 51 |
+
│ - Darwin V7 진화적 모델 머지의 정점 │
|
| 52 |
+
│ - Qwen 3.6 + 한국어 도메인 특화 가족원의 MRI-Aware 머지 │
|
| 53 |
+
│ - 추론(GPQA 88.4%) + 한국어(CLIcK·KMMLU) 양수겸장 │
|
| 54 |
│ - <think> 트레이스로 단계별 사고 │
|
|
|
|
| 55 |
│ │
|
| 56 |
└──────────────────────────────────────────────────────────────────────────────┘
|
| 57 |
|
|
|
|
| 93 |
║ ginigen-ai/Rogue-28B-MIX (Apache 2.0, Private) ║
|
| 94 |
║ ║
|
| 95 |
║ ✦ 조상의 능력 모두 계승 ║
|
| 96 |
+
║ - 친가 → 추론·생각 트레이스 (Darwin-28B-Opus) ║
|
| 97 |
║ - 외가 → 한국어·K-AI 도메인 지식 (Quetta) ║
|
| 98 |
║ ║
|
| 99 |
║ ✦ Smart MRI Streaming Merge ║
|
|
|
|
| 113 |
|
| 114 |
## 📊 평가 (한국어 공개 10 데이터셋, 100문제 × 1 seed, temperature=0)
|
| 115 |
|
| 116 |
+
| Dataset | 우리(Rogue) | 엄마(Quetta) | vs 엄마 |
|
| 117 |
+
|---|---:|---:|:---:|
|
| 118 |
+
| CLIcK | **84%** | 85% | -1pp |
|
| 119 |
+
| KMMLU History | **48%** | 45% | **+3pp 🏆** |
|
| 120 |
+
| KMMLU Law | 25% | 26% | -1pp |
|
| 121 |
+
| KMMLU Health | **81%** | 80% | **+1pp 🏆** |
|
| 122 |
+
| HAERAE General | 63% | 66% | -3pp |
|
| 123 |
+
| HAERAE History | 89% | 90% | -1pp |
|
| 124 |
+
| HAERAE Linguistics | 90% | 95% | -5pp |
|
| 125 |
+
| KoBEST Hellaswag | 95% | 97% | -2pp |
|
| 126 |
+
| KoBEST COPA | 98% | 99% | -1pp |
|
| 127 |
+
| KoBEST BoolQ | 97% | 97% | 0 |
|
| 128 |
+
| **Macro Avg** | **77.0%** | **78.0%** | **-1.0pp** |
|
| 129 |
+
|
| 130 |
+
엄마 격차 **-1.0pp까지 따라잡았으며**, **K-AI Leaderboard 핵심 카테고리(의료·역사)에서 엄마(Quetta)를 추월**했습니다.
|
| 131 |
|
| 132 |
---
|
| 133 |
|
|
|
|
| 179 |
|
| 180 |
## 📜 라이선스
|
| 181 |
|
| 182 |
+
Apache 2.0 — 상업적 사용 가능. 두 부모 모두 Apache 2.0.
|
| 183 |
|
| 184 |
---
|
| 185 |
|
| 186 |
## 🤝 출처
|
| 187 |
|
| 188 |
+
- 친아빠: https://huggingface.co/FINAL-Bench/Darwin-28B-Opus
|
| 189 |
- 엄마: https://huggingface.co/NewenAI/QuettaLLMs-27B-Koreasoner-V3
|
| 190 |
- 친할아버지/외할아버지: https://huggingface.co/unsloth (Qwen 3.5/3.6 멀티모달)
|
| 191 |
+
- 친할머니: 한국어 도메인 특화 Darwin family member
|
| 192 |
- 외할머니: K-AI Korean Leaderboard ecosystem
|