Update README.md
Browse files
README.md
CHANGED
|
@@ -15,7 +15,7 @@ tags:
|
|
| 15 |
- dbbench
|
| 16 |
---
|
| 17 |
|
| 18 |
-
#
|
| 19 |
|
| 20 |
This repository provides a **LoRA adapter** fine-tuned from
|
| 21 |
**Qwen/Qwen3-4B-Instruct-2507** using **LoRA + Unsloth**.
|
|
@@ -26,11 +26,11 @@ The base model must be loaded separately.
|
|
| 26 |
## Training Objective
|
| 27 |
|
| 28 |
This adapter is trained to improve **multi-turn agent task performance**
|
| 29 |
-
on ALFWorld (household tasks)
|
| 30 |
|
| 31 |
Loss is applied to **all assistant turns** in the multi-turn trajectory,
|
| 32 |
enabling the model to learn environment observation, action selection,
|
| 33 |
-
|
| 34 |
|
| 35 |
## Training Configuration
|
| 36 |
|
|
@@ -49,7 +49,7 @@ from peft import PeftModel
|
|
| 49 |
import torch
|
| 50 |
|
| 51 |
base = "Qwen/Qwen3-4B-Instruct-2507"
|
| 52 |
-
adapter = "
|
| 53 |
|
| 54 |
tokenizer = AutoTokenizer.from_pretrained(base)
|
| 55 |
model = AutoModelForCausalLM.from_pretrained(
|
|
|
|
| 15 |
- dbbench
|
| 16 |
---
|
| 17 |
|
| 18 |
+
# qwen3-4b-agent-trajectory-lora
|
| 19 |
|
| 20 |
This repository provides a **LoRA adapter** fine-tuned from
|
| 21 |
**Qwen/Qwen3-4B-Instruct-2507** using **LoRA + Unsloth**.
|
|
|
|
| 26 |
## Training Objective
|
| 27 |
|
| 28 |
This adapter is trained to improve **multi-turn agent task performance**
|
| 29 |
+
on ALFWorld (household tasks).
|
| 30 |
|
| 31 |
Loss is applied to **all assistant turns** in the multi-turn trajectory,
|
| 32 |
enabling the model to learn environment observation, action selection,
|
| 33 |
+
and recovery from errors.
|
| 34 |
|
| 35 |
## Training Configuration
|
| 36 |
|
|
|
|
| 49 |
import torch
|
| 50 |
|
| 51 |
base = "Qwen/Qwen3-4B-Instruct-2507"
|
| 52 |
+
adapter = "Chattso-GPT/test105"
|
| 53 |
|
| 54 |
tokenizer = AutoTokenizer.from_pretrained(base)
|
| 55 |
model = AutoModelForCausalLM.from_pretrained(
|