Ship trained-policy artifact: evaluation_summary.txt
Browse files
artifacts/evaluation/evaluation_summary.txt
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
ChaosOps AI — evaluation summary
|
| 2 |
+
policies: random, heuristic, oracle, trained tiers: easy, medium, hard episodes/type: 5
|
| 3 |
+
===========================================================================
|
| 4 |
+
policy tier eps success mttr rogue+ fp mean_R med_R
|
| 5 |
+
---------------------------------------------------------------------------
|
| 6 |
+
heuristic easy 20 100% 1.9 0% 0% +94.4 +110.0
|
| 7 |
+
heuristic hard 20 50% 1.2 67% 0% -425.3 -328.0
|
| 8 |
+
heuristic medium 15 100% 1.3 0% 0% +108.7 +110.0
|
| 9 |
+
oracle easy 20 100% 3.0 0% 0% +134.0 +134.0
|
| 10 |
+
oracle hard 20 100% 3.2 100% 0% +170.0 +181.0
|
| 11 |
+
oracle medium 15 100% 3.0 100% 0% +150.7 +134.0
|
| 12 |
+
random easy 20 55% 7.3 0% 0% -315.4 -256.0
|
| 13 |
+
random hard 20 10% 16.0 0% 0% -1356.6 -1435.0
|
| 14 |
+
random medium 15 40% 8.7 0% 0% -641.3 -802.0
|
| 15 |
+
trained easy 20 0% — 0% 0% -251.5 -256.0
|
| 16 |
+
trained hard 20 0% — 0% 0% -826.0 -810.0
|
| 17 |
+
trained medium 15 33% 4.6 20% 0% -314.8 -482.0
|