File size: 3,265 Bytes
9b994fb 6212079 9b994fb 6ec668c aedaa8a 6ec668c 9b994fb ed2fa9d ceb811e ed2fa9d 9b994fb aedaa8a 9b994fb 5ed7bbd ed2fa9d | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 | ---
library_name: transformers
license: apache-2.0
pipeline_tag: text-generation
tags:
- quest
- text-generation
---
# QUEST-35B-MT
This is the **mid-training only** checkpoint of QUEST-35B-A3B (`Qwen3_5MoeForConditionalGeneration`). It has **not** been fine-tuned with SFT or RL and therefore **does not** have the instruction-following or tool-use capabilities required to complete deep research tasks.
It is released as an intermediate artifact for research purposes (e.g., initializing further fine-tuning experiments or studying the effect of mid-training). If you need a usable deep research agent, please use [QUEST-35B-MT+SFT](https://huggingface.co/osunlp/QUEST-35B-MT-Plus-SFT) or [QUEST-35B-RL](https://huggingface.co/osunlp/QUEST-35B-RL) instead.
## Training stage
| Stage | Applied |
| --- | :---: |
| Mid-training (MT) | ✓ |
| Supervised fine-tuning (SFT) | ✗ |
| Reinforcement learning (RL) | ✗ |
## Benchmark results
Not reported — this model lacks task-completion capability without SFT.
## QUEST Family
| Type | Resources |
| --- | --- |
| 35B checkpoints | [RL](https://huggingface.co/osunlp/QUEST-35B-RL), [MT+SFT](https://huggingface.co/osunlp/QUEST-35B-MT-Plus-SFT), [MT](https://huggingface.co/osunlp/QUEST-35B-MT), [SFT](https://huggingface.co/osunlp/QUEST-35B-SFT) |
| 30B checkpoints | [RL](https://huggingface.co/osunlp/QUEST-30B-RL), [MT+SFT](https://huggingface.co/osunlp/QUEST-30B-MT-Plus-SFT), [SFT](https://huggingface.co/osunlp/QUEST-30B-SFT) |
| Smaller checkpoints | [9B](https://huggingface.co/osunlp/QUEST-9B), [4B](https://huggingface.co/osunlp/QUEST-4B), [2B](https://huggingface.co/osunlp/QUEST-2B) |
| Training data | [RL data](https://huggingface.co/datasets/osunlp/QUEST-RL-Data), [SFT objective data](https://huggingface.co/datasets/osunlp/QUEST-SFT-Data-Objective), [SFT open-ended data](https://huggingface.co/datasets/osunlp/QUEST-SFT-Data-Open-ended), [Mid-training data](https://huggingface.co/datasets/osunlp/QUEST-Mid-Training-Data) |
Model selection note: if you only need to evaluate objective tasks and do not
need open-ended task evaluation, we recommend the MT+SFT checkpoints because
they perform better on reasoning-heavy objective benchmarks. For a more comprehensive evaluation
across both objective and open-ended tasks, we recommend the RL checkpoints.
## Quick start
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "osunlp/QUEST-35B-MT"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id, device_map="auto", torch_dtype="auto",
)
```
## License
Released under the **Apache License 2.0**.
## Citation
If our paper or related resources prove valuable to your research, we kindly ask
for a citation.
```bibtex
@misc{xie2026quest,
title={QUEST: Training Frontier Deep Research Agents with Fully Synthetic Tasks},
author={Xie, Jian and Lin, Tianhe and Wang, Zilu and Ning, Yuting and Yao, Yuekun and Xue, Tianci and Zhang, Zhehao and Li, Zhongyang and Zhang, Kai and Wu, Yufan and Chen, Shijie and Gou, Boyu and Han, Mingzhe and Wang, Yifei and Lee, Vint and Wei, Xinpeng and Wang, Xiangjun and Su, Yu and Sun, Huan},
journal={arXiv preprint arXiv:2605.24218},
year={2026}
}
```
|