Improve model card for Fail2Drive and TransFuser++
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,7 +1,10 @@
|
|
| 1 |
---
|
| 2 |
-
|
|
|
|
| 3 |
library_name: pytorch
|
| 4 |
-
|
|
|
|
|
|
|
| 5 |
tags:
|
| 6 |
- carla
|
| 7 |
- carla-simulator
|
|
@@ -11,20 +14,48 @@ tags:
|
|
| 11 |
- carla-leaderboard
|
| 12 |
- transfuser
|
| 13 |
- transfuser++
|
| 14 |
-
|
| 15 |
-
model_name: TransFuser++ (TFv5) CARLA Garage Checkpoints
|
| 16 |
-
language:
|
| 17 |
-
- en
|
| 18 |
---
|
| 19 |
|
| 20 |
# TransFuser++ (TFv5) CARLA Garage Checkpoints
|
| 21 |
|
| 22 |
-
This repository
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
|
| 24 |
-
https://github.com/autonomousvision/carla_garage
|
| 25 |
|
| 26 |
-
https://s3.eu-central-1.amazonaws.com/avg-projects-2/garage_2/models/pretrained_models.zip
|
| 27 |
|
| 28 |
-
|
| 29 |
|
| 30 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
library_name: pytorch
|
| 5 |
+
license: cc-by-4.0
|
| 6 |
+
model_name: TransFuser++ (TFv5) CARLA Garage Checkpoints
|
| 7 |
+
pipeline_tag: robotics
|
| 8 |
tags:
|
| 9 |
- carla
|
| 10 |
- carla-simulator
|
|
|
|
| 14 |
- carla-leaderboard
|
| 15 |
- transfuser
|
| 16 |
- transfuser++
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
---
|
| 18 |
|
| 19 |
# TransFuser++ (TFv5) CARLA Garage Checkpoints
|
| 20 |
|
| 21 |
+
This repository contains pretrained checkpoints for the TransFuser++ (TFv5) model, which serves as a baseline for the **Fail2Drive** benchmark.
|
| 22 |
+
|
| 23 |
+
[**Fail2Drive: Benchmarking Closed-Loop Driving Generalization**](https://huggingface.co/papers/2604.08535)
|
| 24 |
+
|
| 25 |
+
[**Project Page**](https://simonger.github.io/fail2drive/) | [**Code**](https://github.com/autonomousvision/fail2drive)
|
| 26 |
+
|
| 27 |
+
## Introduction
|
| 28 |
+
|
| 29 |
+
Fail2Drive is a paired-route benchmark for closed-loop generalization in CARLA, featuring 200 routes and 17 new scenario classes. It highlights failure modes in state-of-the-art models when facing distribution shifts in appearance, layout, behavior, and robustness. TransFuser++ is an end-to-end autonomous driving agent that utilizes both LiDAR and camera inputs.
|
| 30 |
+
|
| 31 |
+
## Sample Usage
|
| 32 |
+
|
| 33 |
+
To run the TransFuser++ model within the Fail2Drive environment, follow the installation instructions in the [official repository](https://github.com/autonomousvision/fail2drive).
|
| 34 |
+
|
| 35 |
+
Once the environment and simulator are set up, you can evaluate the agent using the following command:
|
| 36 |
+
|
| 37 |
+
```bash
|
| 38 |
+
LIVE_VISU=1 python leaderboard/leaderboard/leaderboard_evaluator_local.py \
|
| 39 |
+
--routes ${WORK_DIR}/fail2drive_split/Generalization_PedestriansOnRoad_1085.xml \
|
| 40 |
+
--agent ${WORK_DIR}/team_code/sensor_agent.py \
|
| 41 |
+
--agent-config /path/to/checkpoint_folder
|
| 42 |
+
```
|
| 43 |
+
|
| 44 |
+
*Note: The `--agent-config` parameter should point to the directory containing both `model.pth` and `config.json`.*
|
| 45 |
+
|
| 46 |
+
## Attribution
|
| 47 |
|
| 48 |
+
This repository re-uploads the pretrained checkpoints originally released by the [CARLA Garage](https://github.com/autonomousvision/carla_garage) project. All credit and attribution belong to the original authors.
|
| 49 |
|
| 50 |
+
Original source: [CARLA Garage Models](https://s3.eu-central-1.amazonaws.com/avg-projects-2/garage_2/models/pretrained_models.zip)
|
| 51 |
|
| 52 |
+
## Citation
|
| 53 |
|
| 54 |
+
```bibtex
|
| 55 |
+
@article{ger2024fail2drive,
|
| 56 |
+
title={Fail2Drive: Benchmarking Closed-Loop Driving Generalization},
|
| 57 |
+
author={Ger, Simon and others},
|
| 58 |
+
journal={arXiv preprint arXiv:2604.08535},
|
| 59 |
+
year={2024}
|
| 60 |
+
}
|
| 61 |
+
```
|