tier 1 · fault_grounded · line view · 2 classes · all cells measured
Headline metric balanced_accuracy (↑ higher is better); full metric set: balanced_accuracy · macro_f1 · accuracy. Metrics are a frozen contract (src/evemtbench/evaluation/metrics.py); label derivation: src/evemtbench/tasks/labels.
event flt_1phg_shc_w_arc · grid double_line (adapt_grid/test split) · sample 29, window #667, cubicle 3 (max-RMS) · 50 ms / 480 samples @ 9.6 kHz · top: 3-phase current, bottom: 3-phase voltage · figure provenance in assets/manifest.json
| task | grid | baseline | headline | test | benchmark | params | fit/seed | trace |
|---|---|---|---|---|---|---|---|---|
| fault_grounded_line | cigre_mv | majority | balanced_accuracy ↑ | 0.500 ± 0.000 (n=5) | 0.500 ± 0.000 (n=5) | — | 0s | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | cigre_mv | random_forest | balanced_accuracy ↑ | 0.945 ± 0.001 (n=5) | 0.982 ± 0.000 (n=5) | — | 12s | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | cigre_mv | mlp | balanced_accuracy ↑ | 0.947 ± 0.001 (n=5) | 0.987 ± 0.001 (n=5) | 3.1M | 41s | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | cigre_mv | gru | balanced_accuracy ↑ | 0.946 ± 0.010 (n=5) | 0.985 ± 0.007 (n=5) | 55k | 1.4m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | cigre_mv | cnn | balanced_accuracy ↑ | 0.960 ± 0.008 (n=5) | 0.994 ± 0.004 (n=5) | 51k | 1.2m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | cigre_mv | resnet | balanced_accuracy ↑ | 0.963 ± 0.007 (n=5) | 0.996 ± 0.001 (n=5) | 509k | 5.6m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | double_line | majority | balanced_accuracy ↑ | 0.500 ± 0.000 (n=5) | 0.500 ± 0.000 (n=5) | — | 0s | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | double_line | random_forest | balanced_accuracy ↑ | 0.940 ± 0.001 (n=5) | 0.686 ± 0.009 (n=5) | — | 11s | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | double_line | mlp | balanced_accuracy ↑ | 0.970 ± 0.000 (n=5) | 0.996 ± 0.000 (n=5) | 3.1M | 1.4m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | double_line | gru | balanced_accuracy ↑ | 0.970 ± 0.001 (n=5) | 0.998 ± 0.000 (n=5) | 55k | 1.7m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | double_line | cnn | balanced_accuracy ↑ | 0.970 ± 0.000 (n=5) | 1.000 ± 0.000 (n=5) | 51k | 2.1m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | double_line | resnet | balanced_accuracy ↑ | 0.971 ± 0.000 (n=5) | 1.000 ± 0.000 (n=5) | 509k | 7.5m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | testgrid_110kv | majority | balanced_accuracy ↑ | 0.500 ± 0.000 (n=5) | 0.500 ± 0.000 (n=5) | — | 0s | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | testgrid_110kv | random_forest | balanced_accuracy ↑ | 0.938 ± 0.001 (n=5) | 0.829 ± 0.009 (n=5) | — | 11s | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | testgrid_110kv | mlp | balanced_accuracy ↑ | 0.968 ± 0.001 (n=5) | 0.996 ± 0.000 (n=5) | 3.1M | 1.0m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | testgrid_110kv | gru | balanced_accuracy ↑ | 0.969 ± 0.001 (n=5) | 0.998 ± 0.001 (n=5) | 55k | 2.3m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.969 ± 0.001 (n=5) | 1.000 ± 0.000 (n=5) | 51k | 1.7m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | testgrid_110kv | resnet | balanced_accuracy ↑ | 0.969 ± 0.002 (n=5) | 0.998 ± 0.003 (n=5) | 509k | 5.2m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | ieee39 | majority | balanced_accuracy ↑ | 0.500 ± 0.000 (n=5) | 0.500 ± 0.000 (n=5) | — | 0s | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | ieee39 | random_forest | balanced_accuracy ↑ | 0.952 ± 0.001 (n=5) | 0.910 ± 0.001 (n=5) | — | 16s | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | ieee39 | mlp | balanced_accuracy ↑ | 0.970 ± 0.000 (n=5) | 0.998 ± 0.000 (n=5) | 3.1M | 45s | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | ieee39 | gru | balanced_accuracy ↑ | 0.969 ± 0.001 (n=5) | 0.998 ± 0.001 (n=5) | 55k | 1.7m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | ieee39 | cnn | balanced_accuracy ↑ | 0.970 ± 0.000 (n=5) | 0.999 ± 0.000 (n=5) | 51k | 1.7m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | ieee39 | resnet | balanced_accuracy ↑ | 0.970 ± 0.000 (n=5) | 0.998 ± 0.001 (n=5) | 509k | 6.4m | trace: output · eval-code · log · train-code · config · W&B |
headline & reported metrics for this view — the metric set is a frozen contract; each links to the exact function that computes it
| metric | definition | entry |
|---|---|---|
balanced_accuracy | mean of per-class recall — the majority class cannot buy a good score | evaluate() |
macro_f1 | unweighted mean of per-class F1 (zero_division=0) | evaluate() |
accuracy | fraction of exact-match predictions | evaluate() |
PYTHONPATH=src python -m evemtbench.baselines.runner --task fault_grounded_line --protocol held_out \
--grid <grid> --baseline <baseline> --seeds 0 1 2 3 4