File size: 2,874 Bytes
bc1412d
 
b2122fd
bc1412d
 
 
 
 
 
 
 
a4daf55
525fa30
fef87d1
525fa30
a4daf55
525fa30
a4daf55
 
 
 
 
bc1412d
3898c47
 
 
 
 
 
 
39d27c7
3898c47
 
 
 
 
 
bc1412d
 
 
 
 
 
 
 
525fa30
bc1412d
 
 
a3aef07
 
 
 
3898c47
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
---
library_name: transformers
license: apache-2.0
pipeline_tag: text-generation
tags:
- quest
- text-generation
---

# QUEST-30B-MT+SFT

QUEST **30B** checkpoint after **mid-training + SFT** (Qwen3-30B-A3B base, dense). This is an intermediate artifact in the QUEST 30B training pipeline (MT → SFT → RL).

We did not run benchmark evaluations on this checkpoint. For full pipeline results, see [QUEST-30B-RL](https://huggingface.co/osunlp/QUEST-30B-RL).

## Training stage

| Stage | Applied |
| --- | :---: |
| Mid-training (MT) | ✓ |
| Supervised fine-tuning (SFT) | ✓ |
| Reinforcement learning (RL) | ✗ |

## QUEST Family

| Type | Resources |
| --- | --- |
| 35B checkpoints | [RL](https://huggingface.co/osunlp/QUEST-35B-RL), [MT+SFT](https://huggingface.co/osunlp/QUEST-35B-MT-Plus-SFT), [MT](https://huggingface.co/osunlp/QUEST-35B-MT), [SFT](https://huggingface.co/osunlp/QUEST-35B-SFT) |
| 30B checkpoints | [RL](https://huggingface.co/osunlp/QUEST-30B-RL), [MT+SFT](https://huggingface.co/osunlp/QUEST-30B-MT-Plus-SFT), [SFT](https://huggingface.co/osunlp/QUEST-30B-SFT) |
| Smaller checkpoints | [9B](https://huggingface.co/osunlp/QUEST-9B), [4B](https://huggingface.co/osunlp/QUEST-4B), [2B](https://huggingface.co/osunlp/QUEST-2B) |
| Training data | [RL data](https://huggingface.co/datasets/osunlp/QUEST-RL-Data), [SFT objective data](https://huggingface.co/datasets/osunlp/QUEST-SFT-Data-Objective), [SFT open-ended data](https://huggingface.co/datasets/osunlp/QUEST-SFT-Data-Open-ended), [Mid-training data](https://huggingface.co/datasets/osunlp/QUEST-Mid-Training-Data) |

Model selection note: if you only need to evaluate objective tasks and do not
need open-ended task evaluation, we recommend the MT+SFT checkpoints because
they perform better on reasoning-heavy objective benchmarks. For a more comprehensive evaluation
across both objective and open-ended tasks, we recommend the RL checkpoints.

## Quick start

```python
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "osunlp/QUEST-30B-MT-Plus-SFT"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id, device_map="auto", torch_dtype="auto",
)
```

## License

Released under the **Apache License 2.0**.

## Citation

If our paper or related resources prove valuable to your research, we kindly ask
for a citation.

```bibtex
@misc{xie2026quest,
  title={QUEST: Training Frontier Deep Research Agents with Fully Synthetic Tasks},
  author={Xie, Jian and Lin, Tianhe and Wang, Zilu and Ning, Yuting and Yao, Yuekun and Xue, Tianci and Zhang, Zhehao and Li, Zhongyang and Zhang, Kai and Wu, Yufan and Chen, Shijie and Gou, Boyu and Han, Mingzhe and Wang, Yifei and Lee, Vint and Wei, Xinpeng and Wang, Xiangjun and Su, Yu and Sun, Huan},
  journal={arXiv preprint arXiv:2605.24218},
  year={2026}
}
```