| ChaosOps AI — evaluation summary | |
| policies: random, heuristic, oracle, trained tiers: easy, medium, hard episodes/type: 5 | |
| =========================================================================== | |
| policy tier eps success mttr rogue+ fp mean_R med_R | |
| --------------------------------------------------------------------------- | |
| heuristic easy 20 100% 1.9 0% 0% +94.4 +110.0 | |
| heuristic hard 20 50% 1.2 67% 0% -425.3 -328.0 | |
| heuristic medium 15 100% 1.3 0% 0% +108.7 +110.0 | |
| oracle easy 20 100% 3.0 0% 0% +134.0 +134.0 | |
| oracle hard 20 100% 3.2 100% 0% +170.0 +181.0 | |
| oracle medium 15 100% 3.0 100% 0% +150.7 +134.0 | |
| random easy 20 55% 7.3 0% 0% -315.4 -256.0 | |
| random hard 20 10% 16.0 0% 0% -1356.6 -1435.0 | |
| random medium 15 40% 8.7 0% 0% -641.3 -802.0 | |
| trained easy 20 85% 3.0 0% 35% +49.2 +134.0 | |
| trained hard 20 40% 3.0 93% 35% -433.4 -500.0 | |
| trained medium 15 80% 3.0 100% 13% -16.9 +134.0 | |