Baseline — mlp

benchmark version 1.1.0 · held_out results v1.0.0 · splits v1.0/held_out, v1.1/multi_grid
updated 2026-09-29 13:18 UTC · git 7243f310ddbc
What it does. A multi-layer perceptron on the flattened window. The simplest learned neural baseline: no temporal inductive bias, so it measures how far raw capacity gets without architecture. Its parameter count grows with the global view width, which is why it is the largest model on ieee39.

Reference: Rumelhart et al., Nature 1986 · Implementation: src/evemtbench/baselines/mlp.py

Results (held_out)

mlp — every task × grid; click headers to sort
taskgridbaselineheadlinetestbenchmarkparamsfit/seedtrace
event_classification_globalcigre_mvmlpbalanced_accuracy ↑0.521 ± 0.002 (n=5)0.542 ± 0.006 (n=5)42.9M43.0mtrace: output · eval-code · log · train-code · config · W&B
event_classification_globaldouble_linemlpbalanced_accuracy ↑0.536 ± 0.004 (n=5)0.573 ± 0.013 (n=5)12.0M9.7mtrace: output · eval-code · log · train-code · config · W&B
event_classification_globaltestgrid_110kvmlpbalanced_accuracy ↑0.556 ± 0.002 (n=5)0.584 ± 0.020 (n=5)26.7M20.4mtrace: output · eval-code · log · train-code · config · W&B
event_classification_globalieee39mlpbalanced_accuracy ↑0.616 ± 0.003 (n=5)0.262 ± 0.007 (n=5)103.4M1.8htrace: output · eval-code · log · train-code · config · W&B
event_detection_globalcigre_mvmlpbalanced_accuracy ↑0.748 ± 0.002 (n=5)0.957 ± 0.000 (n=5)42.9M36.5mtrace: output · eval-code · log · train-code · config · W&B
event_detection_globaldouble_linemlpbalanced_accuracy ↑0.786 ± 0.001 (n=5)0.984 ± 0.000 (n=5)12.0M8.9mtrace: output · eval-code · log · train-code · config · W&B
event_detection_globaltestgrid_110kvmlpbalanced_accuracy ↑0.790 ± 0.003 (n=5)0.984 ± 0.000 (n=5)26.7M20.6mtrace: output · eval-code · log · train-code · config · W&B
event_detection_globalieee39mlpbalanced_accuracy ↑0.843 ± 0.001 (n=5)0.981 ± 0.001 (n=5)103.4M1.6htrace: output · eval-code · log · train-code · config · W&B
event_state_globalcigre_mvmlpbalanced_accuracy ↑0.659 ± 0.001 (n=5)0.798 ± 0.002 (n=5)42.9M38.6mtrace: output · eval-code · log · train-code · config · W&B
event_state_globaldouble_linemlpbalanced_accuracy ↑0.702 ± 0.001 (n=5)0.808 ± 0.000 (n=5)12.0M8.8mtrace: output · eval-code · log · train-code · config · W&B
event_state_globaltestgrid_110kvmlpbalanced_accuracy ↑0.706 ± 0.001 (n=5)0.805 ± 0.001 (n=5)26.7M19.1mtrace: output · eval-code · log · train-code · config · W&B
event_state_globalieee39mlpbalanced_accuracy ↑0.787 ± 0.001 (n=5)0.749 ± 0.026 (n=5)103.4M2.0htrace: output · eval-code · log · train-code · config · W&B
fault_category_globalcigre_mvmlpbalanced_accuracy ↑0.634 ± 0.009 (n=5)0.668 ± 0.043 (n=5)42.9M10.1mtrace: output · eval-code · log · train-code · config · W&B
fault_category_globaldouble_linemlpbalanced_accuracy ↑0.962 ± 0.001 (n=5)0.995 ± 0.001 (n=5)12.0M3.3mtrace: output · eval-code · log · train-code · config · W&B
fault_category_globaltestgrid_110kvmlpbalanced_accuracy ↑0.956 ± 0.007 (n=5)0.993 ± 0.003 (n=5)26.7M5.0mtrace: output · eval-code · log · train-code · config · W&B
fault_category_globalieee39mlpbalanced_accuracy ↑0.962 ± 0.001 (n=5)0.536 ± 0.088 (n=5)103.4M31.4mtrace: output · eval-code · log · train-code · config · W&B
fault_category_linecigre_mvmlpbalanced_accuracy ↑0.649 ± 0.003 (n=5)0.662 ± 0.001 (n=5)3.1M39strace: output · eval-code · log · train-code · config · W&B
fault_category_linedouble_linemlpbalanced_accuracy ↑0.964 ± 0.000 (n=5)0.998 ± 0.001 (n=5)3.1M1.3mtrace: output · eval-code · log · train-code · config · W&B
fault_category_linetestgrid_110kvmlpbalanced_accuracy ↑0.955 ± 0.000 (n=5)0.995 ± 0.000 (n=5)3.1M59strace: output · eval-code · log · train-code · config · W&B
fault_category_lineieee39mlpbalanced_accuracy ↑0.963 ± 0.003 (n=5)0.998 ± 0.002 (n=5)3.1M32strace: output · eval-code · log · train-code · config · W&B
fault_category_localcigre_mvmlpbalanced_accuracy ↑0.636 ± 0.004 (n=5)0.655 ± 0.002 (n=5)1.6M32strace: output · eval-code · log · train-code · config · W&B
fault_category_localdouble_linemlpbalanced_accuracy ↑0.951 ± 0.001 (n=5)0.985 ± 0.001 (n=5)1.6M52strace: output · eval-code · log · train-code · config · W&B
fault_category_localtestgrid_110kvmlpbalanced_accuracy ↑0.945 ± 0.001 (n=5)0.985 ± 0.001 (n=5)1.6M52strace: output · eval-code · log · train-code · config · W&B
fault_category_localieee39mlpbalanced_accuracy ↑0.959 ± 0.001 (n=5)0.993 ± 0.001 (n=5)1.6M29strace: output · eval-code · log · train-code · config · W&B
fault_classification_globalcigre_mvmlpbalanced_accuracy ↑0.523 ± 0.003 (n=5)0.542 ± 0.001 (n=5)42.9M9.8mtrace: output · eval-code · log · train-code · config · W&B
fault_classification_globaldouble_linemlpbalanced_accuracy ↑0.676 ± 0.007 (n=5)0.717 ± 0.002 (n=5)12.0M3.2mtrace: output · eval-code · log · train-code · config · W&B
fault_classification_globaltestgrid_110kvmlpbalanced_accuracy ↑0.676 ± 0.004 (n=5)0.713 ± 0.001 (n=5)26.7M6.1mtrace: output · eval-code · log · train-code · config · W&B
fault_classification_globalieee39mlpbalanced_accuracy ↑0.645 ± 0.004 (n=5)0.606 ± 0.041 (n=5)103.4M33.1mtrace: output · eval-code · log · train-code · config · W&B
fault_classification_linecigre_mvmlpbalanced_accuracy ↑0.523 ± 0.002 (n=5)0.549 ± 0.002 (n=5)3.1M1.0mtrace: output · eval-code · log · train-code · config · W&B
fault_classification_linedouble_linemlpbalanced_accuracy ↑0.704 ± 0.005 (n=5)0.716 ± 0.001 (n=5)3.1M1.1mtrace: output · eval-code · log · train-code · config · W&B
fault_classification_linetestgrid_110kvmlpbalanced_accuracy ↑0.679 ± 0.005 (n=5)0.715 ± 0.001 (n=5)3.1M1.0mtrace: output · eval-code · log · train-code · config · W&B
fault_classification_lineieee39mlpbalanced_accuracy ↑0.674 ± 0.005 (n=5)0.715 ± 0.000 (n=5)3.1M2.1mtrace: output · eval-code · log · train-code · config · W&B
fault_classification_localcigre_mvmlpbalanced_accuracy ↑0.527 ± 0.005 (n=5)0.546 ± 0.002 (n=5)1.6M54strace: output · eval-code · log · train-code · config · W&B
fault_classification_localdouble_linemlpbalanced_accuracy ↑0.679 ± 0.004 (n=5)0.704 ± 0.001 (n=5)1.6M55strace: output · eval-code · log · train-code · config · W&B
fault_classification_localtestgrid_110kvmlpbalanced_accuracy ↑0.656 ± 0.010 (n=5)0.705 ± 0.001 (n=5)1.6M51strace: output · eval-code · log · train-code · config · W&B
fault_classification_localieee39mlpbalanced_accuracy ↑0.675 ± 0.003 (n=5)0.711 ± 0.000 (n=5)1.6M1.5mtrace: output · eval-code · log · train-code · config · W&B
fault_detection_globalcigre_mvmlpbalanced_accuracy ↑0.763 ± 0.001 (n=5)0.959 ± 0.000 (n=5)42.9M14.2mtrace: output · eval-code · log · train-code · config · W&B
fault_detection_globaldouble_linemlpbalanced_accuracy ↑0.849 ± 0.001 (n=5)0.986 ± 0.000 (n=5)12.0M4.4mtrace: output · eval-code · log · train-code · config
fault_detection_globaltestgrid_110kvmlpbalanced_accuracy ↑0.848 ± 0.001 (n=5)0.985 ± 0.000 (n=5)26.7M8.4mtrace: output · eval-code · log · train-code · config · W&B
fault_detection_globalieee39mlpbalanced_accuracy ↑0.854 ± 0.000 (n=5)0.714 ± 0.072 (n=5)103.4M47.3mtrace: output · eval-code · log · train-code · config · W&B
fault_detection_linecigre_mvmlpbalanced_accuracy ↑0.776 ± 0.002 (n=5)0.964 ± 0.000 (n=5)3.1M1.3mtrace: output · eval-code · log · train-code · config · W&B
fault_detection_linedouble_linemlpbalanced_accuracy ↑0.854 ± 0.001 (n=5)0.987 ± 0.000 (n=5)3.1M1.4mtrace: output · eval-code · log · train-code · config · W&B
fault_detection_linetestgrid_110kvmlpbalanced_accuracy ↑0.849 ± 0.002 (n=5)0.985 ± 0.000 (n=5)3.1M1.3mtrace: output · eval-code · log · train-code · config · W&B
fault_detection_lineieee39mlpbalanced_accuracy ↑0.866 ± 0.001 (n=5)0.987 ± 0.000 (n=5)3.1M1.4mtrace: output · eval-code · log · train-code · config · W&B
fault_detection_localcigre_mvmlpbalanced_accuracy ↑0.772 ± 0.002 (n=5)0.958 ± 0.003 (n=5)1.6M2.9mtrace: output · eval-code · log · train-code · config · W&B
fault_detection_localdouble_linemlpbalanced_accuracy ↑0.850 ± 0.001 (n=5)0.981 ± 0.000 (n=5)1.6M1.1mtrace: output · eval-code · log · train-code · config · W&B
fault_detection_localtestgrid_110kvmlpbalanced_accuracy ↑0.847 ± 0.001 (n=5)0.982 ± 0.000 (n=5)1.6M1.1mtrace: output · eval-code · log · train-code · config · W&B
fault_detection_localieee39mlpbalanced_accuracy ↑0.863 ± 0.001 (n=5)0.984 ± 0.000 (n=5)1.6M1.2mtrace: output · eval-code · log · train-code · config · W&B
fault_grounded_globalcigre_mvmlpbalanced_accuracy ↑0.928 ± 0.013 (n=5)0.975 ± 0.008 (n=5)42.9M7.0mtrace: output · eval-code · log · train-code · config · W&B
fault_grounded_globaldouble_linemlpbalanced_accuracy ↑0.969 ± 0.000 (n=5)0.998 ± 0.001 (n=5)12.0M3.3mtrace: output · eval-code · log · train-code · config · W&B
fault_grounded_globaltestgrid_110kvmlpbalanced_accuracy ↑0.969 ± 0.000 (n=5)0.995 ± 0.000 (n=5)26.7M6.3mtrace: output · eval-code · log · train-code · config · W&B
fault_grounded_globalieee39mlpbalanced_accuracy ↑0.950 ± 0.003 (n=5)0.926 ± 0.006 (n=5)103.4M33.0mtrace: output · eval-code · log · train-code · config · W&B
fault_grounded_linecigre_mvmlpbalanced_accuracy ↑0.947 ± 0.001 (n=5)0.987 ± 0.001 (n=5)3.1M41strace: output · eval-code · log · train-code · config · W&B
fault_grounded_linedouble_linemlpbalanced_accuracy ↑0.970 ± 0.000 (n=5)0.996 ± 0.000 (n=5)3.1M1.4mtrace: output · eval-code · log · train-code · config · W&B
fault_grounded_linetestgrid_110kvmlpbalanced_accuracy ↑0.968 ± 0.001 (n=5)0.996 ± 0.000 (n=5)3.1M1.0mtrace: output · eval-code · log · train-code · config · W&B
fault_grounded_lineieee39mlpbalanced_accuracy ↑0.970 ± 0.000 (n=5)0.998 ± 0.000 (n=5)3.1M45strace: output · eval-code · log · train-code · config · W&B
fault_grounded_localcigre_mvmlpbalanced_accuracy ↑0.948 ± 0.001 (n=5)0.983 ± 0.001 (n=5)1.6M31strace: output · eval-code · log · train-code · config · W&B
fault_grounded_localdouble_linemlpbalanced_accuracy ↑0.968 ± 0.000 (n=5)0.991 ± 0.001 (n=5)1.6M1.2mtrace: output · eval-code · log · train-code · config · W&B
fault_grounded_localtestgrid_110kvmlpbalanced_accuracy ↑0.956 ± 0.002 (n=5)0.990 ± 0.001 (n=5)1.6M51strace: output · eval-code · log · train-code · config · W&B
fault_grounded_localieee39mlpbalanced_accuracy ↑0.968 ± 0.000 (n=5)0.995 ± 0.000 (n=5)1.6M35strace: output · eval-code · log · train-code · config · W&B
fault_location_globalcigre_mvmlpmae ↓22.196 ± 0.031 (n=5)18.868 ± 0.943 (n=5)42.9M9.6mtrace: output · eval-code · log · train-code · config · W&B
fault_location_globaldouble_linemlpmae ↓16.338 ± 0.125 (n=5)6.296 ± 0.269 (n=5)12.0M3.0mtrace: output · eval-code · log · train-code · config · W&B
fault_location_globaltestgrid_110kvmlpmae ↓16.994 ± 0.043 (n=5)6.538 ± 0.115 (n=5)26.7M6.5mtrace: output · eval-code · log · train-code · config · W&B
fault_location_globalieee39mlpmae ↓20.697 ± 0.115 (n=5)20.389 ± 0.724 (n=5)103.4M33.6mtrace: output · eval-code · log · train-code · config · W&B
fault_location_linecigre_mvmlpmae ↓23.915 ± 0.057 (n=5)30.470 ± 0.095 (n=5)3.1M21strace: output · eval-code · log · train-code · config · W&B
fault_location_linedouble_linemlpmae ↓16.095 ± 0.030 (n=5)5.179 ± 0.243 (n=5)3.1M1.1mtrace: output · eval-code · log · train-code · config · W&B
fault_location_linetestgrid_110kvmlpmae ↓17.141 ± 0.065 (n=5)6.545 ± 0.540 (n=5)3.1M59strace: output · eval-code · log · train-code · config · W&B
fault_location_lineieee39mlpmae ↓18.681 ± 0.137 (n=5)9.396 ± 0.257 (n=5)3.1M1.0mtrace: output · eval-code · log · train-code · config · W&B
fault_location_localcigre_mvmlpmae ↓23.943 ± 0.040 (n=5)30.530 ± 0.155 (n=5)1.6M17strace: output · eval-code · log · train-code · config · W&B
fault_location_localdouble_linemlpmae ↓19.690 ± 0.037 (n=5)15.204 ± 0.163 (n=5)1.6M55strace: output · eval-code · log · train-code · config · W&B
fault_location_localtestgrid_110kvmlpmae ↓20.435 ± 0.046 (n=5)17.456 ± 0.118 (n=5)1.6M53strace: output · eval-code · log · train-code · config · W&B
fault_location_localieee39mlpmae ↓22.484 ± 0.027 (n=5)21.403 ± 0.013 (n=5)1.6M60strace: output · eval-code · log · train-code · config · W&B
fault_origin_globalcigre_mvmlpbalanced_accuracy ↑0.774 ± 0.020 (n=5)0.969 ± 0.021 (n=5)42.9M9.0mtrace: output · eval-code · log · train-code · config · W&B
fault_origin_globaldouble_linemlpbalanced_accuracy ↑0.865 ± 0.003 (n=5)0.990 ± 0.005 (n=5)12.0M3.0mtrace: output · eval-code · log · train-code · config · W&B
fault_origin_globaltestgrid_110kvmlpbalanced_accuracy ↑0.854 ± 0.007 (n=5)0.984 ± 0.016 (n=5)26.7M8.5mtrace: output · eval-code · log · train-code · config · W&B
fault_origin_globalieee39mlpbalanced_accuracy ↑0.869 ± 0.003 (n=5)0.970 ± 0.003 (n=5)103.4M32.4mtrace: output · eval-code · log · train-code · config · W&B
fault_phase_globalcigre_mvmlpbalanced_accuracy ↑0.807 ± 0.003 (n=5)0.964 ± 0.003 (n=5)42.9M8.9mtrace: output · eval-code · log · train-code · config · W&B
fault_phase_globaldouble_linemlpbalanced_accuracy ↑0.852 ± 0.003 (n=5)0.983 ± 0.001 (n=5)12.0M8.6mtrace: output · eval-code · log · train-code · config · W&B
fault_phase_globaltestgrid_110kvmlpbalanced_accuracy ↑0.849 ± 0.004 (n=5)0.982 ± 0.001 (n=5)26.7M6.2mtrace: output · eval-code · log · train-code · config · W&B
fault_phase_globalieee39mlpbalanced_accuracy ↑0.848 ± 0.001 (n=5)0.939 ± 0.006 (n=5)103.4M31.9mtrace: output · eval-code · log · train-code · config · W&B
fault_phase_linecigre_mvmlpbalanced_accuracy ↑0.805 ± 0.002 (n=5)0.966 ± 0.001 (n=5)3.1M35strace: output · eval-code · log · train-code · config · W&B
fault_phase_linedouble_linemlpbalanced_accuracy ↑0.849 ± 0.002 (n=5)0.983 ± 0.001 (n=5)3.1M1.3mtrace: output · eval-code · log · train-code · config · W&B
fault_phase_linetestgrid_110kvmlpbalanced_accuracy ↑0.856 ± 0.004 (n=5)0.983 ± 0.000 (n=5)3.1M1.1mtrace: output · eval-code · log · train-code · config · W&B
fault_phase_lineieee39mlpbalanced_accuracy ↑0.854 ± 0.002 (n=5)0.982 ± 0.000 (n=5)3.1M44strace: output · eval-code · log · train-code · config · W&B
fault_phase_localcigre_mvmlpbalanced_accuracy ↑0.810 ± 0.004 (n=5)0.963 ± 0.001 (n=5)1.6M29strace: output · eval-code · log · train-code · config · W&B
fault_phase_localdouble_linemlpbalanced_accuracy ↑0.850 ± 0.005 (n=5)0.979 ± 0.001 (n=5)1.6M56strace: output · eval-code · log · train-code · config · W&B
fault_phase_localtestgrid_110kvmlpbalanced_accuracy ↑0.843 ± 0.004 (n=5)0.979 ± 0.000 (n=5)1.6M1.2mtrace: output · eval-code · log · train-code · config · W&B
fault_phase_localieee39mlpbalanced_accuracy ↑0.856 ± 0.001 (n=5)0.980 ± 0.000 (n=5)1.6M34strace: output · eval-code · log · train-code · config · W&B
switch_detection_globalcigre_mvmlpbalanced_accuracy ↑0.688 ± 0.002 (n=5)0.710 ± 0.001 (n=5)42.9M36.6mtrace: output · eval-code · log · train-code · config · W&B
switch_detection_globaldouble_linemlpbalanced_accuracy ↑0.701 ± 0.000 (n=5)0.730 ± 0.002 (n=5)12.0M10.3mtrace: output · eval-code · log · train-code · config · W&B
switch_detection_globaltestgrid_110kvmlpbalanced_accuracy ↑0.711 ± 0.001 (n=5)0.734 ± 0.003 (n=5)26.7M19.6mtrace: output · eval-code · log · train-code · config · W&B
switch_detection_globalieee39mlpbalanced_accuracy ↑0.754 ± 0.015 (n=5)0.760 ± 0.016 (n=5)103.4M1.6htrace: output · eval-code · log · train-code · config · W&B
switch_type_globalcigre_mvmlpbalanced_accuracy ↑0.592 ± 0.002 (n=5)0.687 ± 0.013 (n=5)42.9M10.7mtrace: output · eval-code · log · train-code · config · W&B
switch_type_globaldouble_linemlpbalanced_accuracy ↑0.705 ± 0.009 (n=5)0.732 ± 0.011 (n=5)12.0M4.5mtrace: output · eval-code · log · train-code · config · W&B
switch_type_globaltestgrid_110kvmlpbalanced_accuracy ↑0.694 ± 0.002 (n=5)0.692 ± 0.026 (n=5)26.7M6.2mtrace: output · eval-code · log · train-code · config · W&B
switch_type_globalieee39mlpbalanced_accuracy ↑0.719 ± 0.005 (n=5)0.270 ± 0.005 (n=5)103.4M20.0mtrace: output · eval-code · log · train-code · config · W&B

Protection-grade & per-class metrics

Dependability/security rates and per-class F1 for this baseline — the same held_out result.json cells the Supplementary (Package C) tables select, traced here so every reported SI number resolves on the dashboard.