docs/source/environments.md

# Environments

The OpenEnv community has built a catalog of ready-to-run environments that cover deterministic smoke tests, full developer workflows, and multi-step reasoning challenges. Explore the surface area below and jump directly into the guides for each environment.

`````{grid} 1 2 3 3

:gutter: 3



````{grid-item-card} Echo

:class-card: sd-border-1



Minimal observation/action loop for verifying client integrations, CI pipelines, and onboarding flows in seconds.



+++

```{button-link} environments/echo.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
```{button-link} https://huggingface.co/spaces/openenv/echo_env

:color: warning

:outline:



🤗 Hugging Face

```
````



````{grid-item-card} Coding

:class-card: sd-border-1



Secure sandbox with filesystem access and evaluation hooks for executing generated code and building autonomous dev workflows.



+++

```{button-link} environments/coding.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
```{button-link} https://huggingface.co/spaces/openenv/coding_env

:color: warning

:outline:



🤗 Hugging Face

```
````



````{grid-item-card} Chat

:class-card: sd-border-1



Message-driven loop tailored for conversational agents that need structured turns, safety rails, and message attribution.



+++

```{button-link} environments/chat.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
```{button-link} https://huggingface.co/spaces/openenv/chat_env

:color: warning

:outline:



🤗 Hugging Face

```
````



````{grid-item-card} Atari

:class-card: sd-border-1



Classic Arcade Learning Environment tasks packaged for fast benchmarking of reinforcement-learning style agents.



+++

```{button-link} environments/atari.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
```{button-link} https://huggingface.co/spaces/openenv/atari_env

:color: warning

:outline:



🤗 Hugging Face

```
````



````{grid-item-card} OpenSpiel

:class-card: sd-border-1



Multi-agent, game-theory workloads powered by DeepMind's OpenSpiel suite, ideal for search and self-play experiments.



+++

```{button-link} environments/openspiel.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
```{button-link} https://huggingface.co/spaces/openenv/openspiel_env

:color: warning

:outline:



🤗 Hugging Face

```
````



````{grid-item-card} SUMO-RL

:class-card: sd-border-1



Traffic control scenarios with SUMO simulators for agents that reason about continuous control and scheduling.



+++

```{button-link} environments/sumo.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



````{grid-item-card} FinRL

:class-card: sd-border-1



Financial market simulations with portfolio APIs, perfect for RLHF strategies and algorithmic trading experiments.



+++

```{button-link} environments/finrl.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



````{grid-item-card} TextArena

:class-card: sd-border-1



Multi-task text arena for language-game competitions such as Wordle, reasoning puzzles, and program synthesis.



+++

```{button-link} environments/textarena.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
```{button-link} https://huggingface.co/spaces/burtenshaw/textarena_env

:color: warning

:outline:



🤗 Hugging Face

```
````



````{grid-item-card} Git

:class-card: sd-border-1



Teaches agents to navigate repositories, inspect diffs, and land changes via Git-native operations.



+++

```{button-link} environments/git.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



````{grid-item-card} DIPG Safety

:class-card: sd-border-1



Safety-critical diagnostics from the DIPG benchmark, highlighting guardrails, adversarial prompts, and risk scoring.



+++

```{button-link} environments/dipg.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
```{button-link} https://huggingface.co/spaces/surfiniaburger/dipg-gym

:color: warning

:outline:



🤗 Hugging Face

```
````



````{grid-item-card} Snake

:class-card: sd-border-1



Classic snake game environment for RL research with configurable grids, partial observability, and customizable rewards.



+++

```{button-link} environments/snake.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
```{button-link} https://huggingface.co/spaces/Crashbandicoote2/snake_env

:color: warning

:outline:



🤗 Hugging Face

```
````



````{grid-item-card} Web Search

:class-card: sd-border-1



Web search environment for RL research with configurable grids, partial observability, and customizable rewards.



+++

```{button-link} environments/websearch.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
```{button-link} https://huggingface.co/spaces/lawhy/web_search

:color: warning

:outline:



🤗 Hugging Face

```
````



````{grid-item-card} BrowserGym

:class-card: sd-border-1



Browser automation environment for web agents with DOM interaction, navigation, and multi-step task completion.



+++

```{button-link} environments/browsergym.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
```{button-link} https://huggingface.co/spaces/burtenshaw/browsergym-v2

:color: warning

:outline:



🤗 Hugging Face

```
````



````{grid-item-card} KernRL

:class-card: sd-border-1



RL environment for GPU kernel optimization. Train LLM agents to write fast CUDA/Triton kernels that beat baseline implementations.



+++

```{button-link} environments/kernrl.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



````{grid-item-card} Calendar

:class-card: sd-border-1



Calendar tool-use environment exposing a Calendar Gym through the OpenEnv reset/step/state interface for scheduling agents.



+++

```{button-link} environments/calendar.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



````{grid-item-card} CARLA

:class-card: sd-border-1



Embodied evaluation environment for testing LLM decision-making in a full 3D driving simulator with irreversible consequences and ethical trolley scenarios.



+++

```{button-link} environments/carla.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
```{button-link} https://huggingface.co/spaces/sergiopaniego/carla-env

:color: warning

:outline:



🤗 Hugging Face

```
````



````{grid-item-card} Chess

:class-card: sd-border-1



Chess RL environment powered by the moonfish engine with configurable opponents, position evaluation, and full chess rules.



+++

```{button-link} environments/chess.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



````{grid-item-card} Connect4

:class-card: sd-border-1



Classic Connect Four board game environment for training agents on turn-based strategy with a 6×7 grid.



+++

```{button-link} environments/connect4.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



````{grid-item-card} DM Control

:class-card: sd-border-1



Generic OpenEnv wrapper for dm_control.suite, providing access to all MuJoCo-based continuous control tasks like cartpole, walker, and humanoid.



+++

```{button-link} environments/dm_control.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



````{grid-item-card} FinQA

:class-card: sd-border-1



Financial question-answering environment that evaluates LLMs on complex financial questions using tool calls on SEC 10-K filing data.



+++

```{button-link} environments/finqa.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



````{grid-item-card} Grid World

:class-card: sd-border-1



Simple 5×5 grid world RL testbed and step-by-step guide for building new OpenEnv environments from scratch.



+++

```{button-link} environments/grid_world.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
```{button-link} https://huggingface.co/spaces/yuvrajpant56/grid_world_env

:color: warning

:outline:



🤗 Hugging Face

```
````



````{grid-item-card} Julia

:class-card: sd-border-1



Julia code execution environment with test result tracking and reward calculation for RL training on Julia programming tasks.



+++

```{button-link} environments/julia.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



````{grid-item-card} Maze

:class-card: sd-border-1



Gridworld maze where agents navigate from start to exit while avoiding walls, with configurable 8×8 layouts.



+++

```{button-link} environments/maze.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



````{grid-item-card} OpenApp

:class-card: sd-border-1



Web application simulation wrapping the OpenApps framework and BrowserGym for training UI agents on calendar, todo, messenger, and maps apps.



+++

```{button-link} environments/openapp.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



````{grid-item-card} Reasoning Gym

:class-card: sd-border-1



Integrates the Reasoning Gym library to provide single-step reasoning tasks with configurable datasets and scoring.



+++

```{button-link} environments/reasoning_gym.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



````{grid-item-card} REPL

:class-card: sd-border-1



Python REPL environment for code execution tasks based on the Recursive Language Models paradigm with sandboxed execution and context loading.



+++

```{button-link} environments/repl.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



````{grid-item-card} TB2

:class-card: sd-border-1



OpenEnv wrapper for Terminal-Bench 2 tasks with local and Docker execution modes for terminal-based agent evaluation.



+++

```{button-link} environments/tbench2.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



````{grid-item-card} Unity

:class-card: sd-border-1



OpenEnv wrapper for Unity ML-Agents environments, providing access to Unity's RL environments through HTTP/WebSocket interfaces.



+++

```{button-link} environments/unity.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



````{grid-item-card} Wildfire

:class-card: sd-border-1



Autonomous wildfire-control simulation where agents contain spreading fires using water, firebreaks, and timing under dynamic conditions.



+++

```{button-link} environments/wildfire.html

:color: primary

:outline:



{octicon}`file;1em` Docs

```
````



`````

```{tip}

Want to publish your own environment? Head over to the [Build Your Own Environment](auto_getting_started/environment-builder.md) guide for a step-by-step walkthrough.

```

## Community Environments

`````{grid} 1 2 3 3

:gutter: 3



````{grid-item-card} RLVE Gym

:class-card: sd-border-1



A suite of 400 environments that procedurally generate reasoning problems for LM training with configurable difficulty.



+++

```{button-link} https://huggingface.co/spaces/ZhiyuanZeng/RLVE_Gym/blob/main/README.md

:color: primary

:outline:



{octicon}`file;1em` Docs

```
```{button-link} https://huggingface.co/spaces/ZhiyuanZeng/RLVE_Gym

:color: warning

:outline:



🤗 Hugging Face

```
````



`````

```{toctree}

:hidden:

:maxdepth: 1



environments/echo

environments/coding

environments/chat

environments/atari

environments/openspiel

environments/sumo

environments/finrl

environments/textarena

environments/git

environments/dipg

environments/snake

environments/websearch

environments/browsergym

environments/repl

environments/calendar

environments/carla

environments/chess

environments/connect4

environments/dm_control

environments/finqa

environments/grid_world

environments/julia

environments/kernrl

environments/maze

environments/openapp

environments/reasoning_gym

environments/tbench2

environments/unity

environments/wildfire

```