midah commited on
Commit
0f666e3
·
verified ·
1 Parent(s): 1d70548

Add README

Browse files
Files changed (1) hide show
  1. README.md +17 -4
README.md CHANGED
@@ -1,10 +1,23 @@
1
  ---
2
- title: Eval Explorer
3
- emoji: 🚀
4
- colorFrom: purple
5
  colorTo: indigo
6
  sdk: static
7
  pinned: false
8
  ---
9
 
10
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: SWE-bench Lite — Eval Explorer
3
+ emoji: 🔍
4
+ colorFrom: blue
5
  colorTo: indigo
6
  sdk: static
7
  pinned: false
8
  ---
9
 
10
+ # SWE-bench Lite Eval Explorer
11
+
12
+ A structural embedding browser over 300 SWE-bench Lite instances. Points are positioned by UMAP applied to AST edit-operation distances — proximity reflects procedural similarity, not semantic content.
13
+
14
+ ## What you can do
15
+
16
+ - **Color by** fix type, repo, pass/fail, structural coverage, task quadrant, or number of models that solved it
17
+ - **Filter** by fix type, repo, or model outcome (solved by ≥1, solved by all, unsolved)
18
+ - **Click any point** to inspect: per-model outcomes (GPT-4, Claude 3.5, GPT-4o, Qwen2.5), fix summary, structural coverage score, behavioral metrics (steps, edit retry rate)
19
+ - **Bar chart** shows live pass rate by fix type for the current filter
20
+
21
+ ## Data
22
+
23
+ Companion dataset: [midah/procedural-info-theory](https://huggingface.co/datasets/midah/procedural-info-theory)