Safetensors
qwen3
Chaox72 commited on
Commit
aeab909
·
verified ·
1 Parent(s): 76b7723

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +51 -0
README.md CHANGED
@@ -1,3 +1,54 @@
1
  ---
2
  license: mit
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
  ---
4
+
5
+ # STT-Agent-SFT
6
+
7
+ This repository contains the **STT-Agent-SFT** model fine-tuned for spatio‑temporal tool use, based on the refined trajectories.
8
+
9
+ ## 📊 Performance on STT-Arena
10
+
11
+ Below is the overall Pass@1 performance of STT-Agent compared to other frontier models:
12
+
13
+
14
+ ![image](https://cdn-uploads.huggingface.co/production/uploads/66fa30dee6210a5175235a3c/jEVVEMz_uIFeGpNirY2vh.png)
15
+
16
+
17
+ ### Ablation: Effect of Iterative Trajectory Refinement
18
+
19
+ | Model | Easy | Medium | Hard | Impossible | Overall | Avg. Calls |
20
+ |-------|------|--------|------|------------|---------|-------------|
21
+ | Qwen-3-4B (baseline) | 18.31 | 9.46 | 2.82 | 10.00 | 10.57 | 7.63 |
22
+ | STT-Agent (w/o refine) | 28.17 | 16.92 | 11.86 | 47.01 | 23.10 | 32.70 |
23
+ | **{model_name} (with refine)** | **26.76** | **17.41** | **13.56** | **61.11** | **25.11** | **15.30** |
24
+
25
+ Trajectory refinement significantly improves both accuracy and efficiency (reduces average API calls).
26
+
27
+ ## 🚀 Usage
28
+
29
+ ```python
30
+ from transformers import AutoModelForCausalLM, AutoTokenizer
31
+
32
+ model_name = "{model_name}"
33
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
34
+ model = AutoModelForCausalLM.from_pretrained(model_name)
35
+
36
+ # Example tool-use prompt
37
+ prompt = "User: Book the cheapest flight from PVG to CDG.\n"
38
+ inputs = tokenizer(prompt, return_tensors="pt")
39
+ outputs = model.generate(**inputs)
40
+ print(tokenizer.decode(outputs[0]))
41
+ ```
42
+
43
+ ## 🧪 Training Details
44
+
45
+ Base model: Qwen-3-4B-Base
46
+ SFT: 2,212 refined trajectories
47
+ RL strategy: REINFORCE++
48
+ Compute: 4× NVIDIA H200 GPUs
49
+
50
+ ## 📄 Citation
51
+
52
+ ```bibtex
53
+ xxx
54
+ ```