Reference: LeCun et al., Proc. IEEE 1998 (1-D adaptation) · Implementation: src/evemtbench/baselines/cnn.py
| task | grid | baseline | headline | test | benchmark | params | fit/seed | trace |
|---|---|---|---|---|---|---|---|---|
| event_classification_global | cigre_mv | cnn | balanced_accuracy ↑ | 0.632 ± 0.011 (n=5) | 0.702 ± 0.011 (n=5) | 127k | 37.9m | trace: output · eval-code · log · train-code · config · W&B |
| event_classification_global | double_line | cnn | balanced_accuracy ↑ | 0.630 ± 0.033 (n=5) | 0.669 ± 0.063 (n=5) | 70k | 9.4m | trace: output · eval-code · log · train-code · config · W&B |
| event_classification_global | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.654 ± 0.011 (n=5) | 0.706 ± 0.015 (n=5) | 97k | 20.3m | trace: output · eval-code · log · train-code · config · W&B |
| event_classification_global | ieee39 | cnn | balanced_accuracy ↑ | 0.582 ± 0.017 (n=5) | 0.226 ± 0.011 (n=5) | 237k | 46.2m | trace: output · eval-code · log · train-code · config · W&B |
| event_detection_global | cigre_mv | cnn | balanced_accuracy ↑ | 0.752 ± 0.015 (n=5) | 0.966 ± 0.006 (n=5) | 124k | 36.8m | trace: output · eval-code · log · train-code · config · W&B |
| event_detection_global | double_line | cnn | balanced_accuracy ↑ | 0.797 ± 0.007 (n=5) | 0.983 ± 0.000 (n=5) | 68k | 9.0m | trace: output · eval-code · log · train-code · config · W&B |
| event_detection_global | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.761 ± 0.009 (n=5) | 0.982 ± 0.001 (n=5) | 94k | 21.1m | trace: output · eval-code · log · train-code · config · W&B |
| event_detection_global | ieee39 | cnn | balanced_accuracy ↑ | 0.786 ± 0.005 (n=5) | 0.706 ± 0.313 (n=5) | 234k | 1.7h | trace: output · eval-code · log · train-code · config · W&B |
| event_state_global | cigre_mv | cnn | balanced_accuracy ↑ | 0.733 ± 0.027 (n=5) | 0.865 ± 0.024 (n=5) | 124k | 38.5m | trace: output · eval-code · log · train-code · config · W&B |
| event_state_global | double_line | cnn | balanced_accuracy ↑ | 0.695 ± 0.004 (n=5) | 0.798 ± 0.009 (n=5) | 68k | 8.9m | trace: output · eval-code · log · train-code · config · W&B |
| event_state_global | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.662 ± 0.021 (n=5) | 0.789 ± 0.030 (n=5) | 95k | 20.0m | trace: output · eval-code · log · train-code · config · W&B |
| event_state_global | ieee39 | cnn | balanced_accuracy ↑ | 0.707 ± 0.016 (n=5) | 0.681 ± 0.144 (n=5) | 234k | 1.7h | trace: output · eval-code · log · train-code · config · W&B |
| fault_category_global | cigre_mv | cnn | balanced_accuracy ↑ | 0.654 ± 0.022 (n=5) | 0.656 ± 0.007 (n=5) | 124k | 5.3m | trace: output · eval-code · log · train-code · config · W&B |
| fault_category_global | double_line | cnn | balanced_accuracy ↑ | 0.960 ± 0.001 (n=5) | 0.995 ± 0.002 (n=5) | 68k | 1.0m | trace: output · eval-code · log · train-code · config · W&B |
| fault_category_global | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.957 ± 0.003 (n=5) | 0.989 ± 0.005 (n=5) | 95k | 14.4m | trace: output · eval-code · log · train-code · config · W&B |
| fault_category_global | ieee39 | cnn | balanced_accuracy ↑ | 0.955 ± 0.002 (n=5) | 0.693 ± 0.332 (n=5) | 234k | 19.0m | trace: output · eval-code · log · train-code · config · W&B |
| fault_category_line | cigre_mv | cnn | balanced_accuracy ↑ | 0.670 ± 0.003 (n=5) | 0.673 ± 0.015 (n=5) | 52k | 1.5m | trace: output · eval-code · log · train-code · config · W&B |
| fault_category_line | double_line | cnn | balanced_accuracy ↑ | 0.964 ± 0.003 (n=5) | 0.999 ± 0.001 (n=5) | 52k | 1.5m | trace: output · eval-code · log · train-code · config · W&B |
| fault_category_line | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.961 ± 0.003 (n=5) | 0.997 ± 0.001 (n=5) | 52k | 1.4m | trace: output · eval-code · log · train-code · config · W&B |
| fault_category_line | ieee39 | cnn | balanced_accuracy ↑ | 0.964 ± 0.003 (n=5) | 0.997 ± 0.002 (n=5) | 52k | 48s | trace: output · eval-code · log · train-code · config · W&B |
| fault_category_local | cigre_mv | cnn | balanced_accuracy ↑ | 0.645 ± 0.016 (n=5) | 0.660 ± 0.004 (n=5) | 49k | 1.0m | trace: output · eval-code · log · train-code · config · W&B |
| fault_category_local | double_line | cnn | balanced_accuracy ↑ | 0.963 ± 0.005 (n=5) | 0.994 ± 0.005 (n=5) | 49k | 1.7m | trace: output · eval-code · log · train-code · config · W&B |
| fault_category_local | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.958 ± 0.004 (n=5) | 0.983 ± 0.005 (n=5) | 49k | 58s | trace: output · eval-code · log · train-code · config · W&B |
| fault_category_local | ieee39 | cnn | balanced_accuracy ↑ | 0.955 ± 0.005 (n=5) | 0.984 ± 0.005 (n=5) | 49k | 28s | trace: output · eval-code · log · train-code · config · W&B |
| fault_classification_global | cigre_mv | cnn | balanced_accuracy ↑ | 0.510 ± 0.012 (n=5) | 0.534 ± 0.006 (n=5) | 125k | 4.6m | trace: output · eval-code · log · train-code · config · W&B |
| fault_classification_global | double_line | cnn | balanced_accuracy ↑ | 0.675 ± 0.013 (n=5) | 0.709 ± 0.003 (n=5) | 68k | 1.1m | trace: output · eval-code · log · train-code · config · W&B |
| fault_classification_global | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.670 ± 0.008 (n=5) | 0.707 ± 0.007 (n=5) | 95k | 2.2m | trace: output · eval-code · log · train-code · config · W&B |
| fault_classification_global | ieee39 | cnn | balanced_accuracy ↑ | 0.634 ± 0.019 (n=5) | 0.385 ± 0.052 (n=5) | 235k | 10.0m | trace: output · eval-code · log · train-code · config · W&B |
| fault_classification_line | cigre_mv | cnn | balanced_accuracy ↑ | 0.576 ± 0.022 (n=5) | 0.589 ± 0.028 (n=5) | 52k | 2.0m | trace: output · eval-code · log · train-code · config · W&B |
| fault_classification_line | double_line | cnn | balanced_accuracy ↑ | 0.792 ± 0.019 (n=5) | 0.811 ± 0.016 (n=5) | 52k | 2.1m | trace: output · eval-code · log · train-code · config · W&B |
| fault_classification_line | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.706 ± 0.012 (n=5) | 0.743 ± 0.021 (n=5) | 52k | 1.7m | trace: output · eval-code · log · train-code · config · W&B |
| fault_classification_line | ieee39 | cnn | balanced_accuracy ↑ | 0.666 ± 0.013 (n=5) | 0.713 ± 0.002 (n=5) | 52k | 1.2m | trace: output · eval-code · log · train-code · config · W&B |
| fault_classification_local | cigre_mv | cnn | balanced_accuracy ↑ | 0.566 ± 0.028 (n=5) | 0.589 ± 0.031 (n=5) | 50k | 1.9m | trace: output · eval-code · log · train-code · config · W&B |
| fault_classification_local | double_line | cnn | balanced_accuracy ↑ | 0.795 ± 0.012 (n=5) | 0.812 ± 0.010 (n=5) | 50k | 2.0m | trace: output · eval-code · log · train-code · config |
| fault_classification_local | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.685 ± 0.005 (n=5) | 0.727 ± 0.004 (n=5) | 50k | 1.8m | trace: output · eval-code · log · train-code · config · W&B |
| fault_classification_local | ieee39 | cnn | balanced_accuracy ↑ | 0.679 ± 0.011 (n=5) | 0.709 ± 0.002 (n=5) | 50k | 1.8m | trace: output · eval-code · log · train-code · config · W&B |
| fault_detection_global | cigre_mv | cnn | balanced_accuracy ↑ | 0.799 ± 0.022 (n=5) | 0.961 ± 0.008 (n=5) | 124k | 12.6m | trace: output · eval-code · log · train-code · config · W&B |
| fault_detection_global | double_line | cnn | balanced_accuracy ↑ | 0.867 ± 0.017 (n=5) | 0.987 ± 0.001 (n=5) | 68k | 3.8m | trace: output · eval-code · log · train-code · config · W&B |
| fault_detection_global | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.878 ± 0.010 (n=5) | 0.987 ± 0.003 (n=5) | 94k | 8.4m | trace: output · eval-code · log · train-code · config · W&B |
| fault_detection_global | ieee39 | cnn | balanced_accuracy ↑ | 0.865 ± 0.010 (n=5) | 0.594 ± 0.267 (n=5) | 234k | 40.9m | trace: output · eval-code · log · train-code · config · W&B |
| fault_detection_line | cigre_mv | cnn | balanced_accuracy ↑ | 0.808 ± 0.034 (n=5) | 0.965 ± 0.008 (n=5) | 51k | 2.2m | trace: output · eval-code · log · train-code · config · W&B |
| fault_detection_line | double_line | cnn | balanced_accuracy ↑ | 0.877 ± 0.011 (n=5) | 0.987 ± 0.001 (n=5) | 51k | 2.4m | trace: output · eval-code · log · train-code · config · W&B |
| fault_detection_line | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.875 ± 0.010 (n=5) | 0.987 ± 0.002 (n=5) | 51k | 2.2m | trace: output · eval-code · log · train-code · config · W&B |
| fault_detection_line | ieee39 | cnn | balanced_accuracy ↑ | 0.895 ± 0.010 (n=5) | 0.987 ± 0.000 (n=5) | 51k | 2.5m | trace: output · eval-code · log · train-code · config · W&B |
| fault_detection_local | cigre_mv | cnn | balanced_accuracy ↑ | 0.826 ± 0.006 (n=5) | 0.970 ± 0.004 (n=5) | 49k | 2.4m | trace: output · eval-code · log · train-code · config · W&B |
| fault_detection_local | double_line | cnn | balanced_accuracy ↑ | 0.872 ± 0.014 (n=5) | 0.987 ± 0.001 (n=5) | 49k | 2.0m | trace: output · eval-code · log · train-code · config · W&B |
| fault_detection_local | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.875 ± 0.014 (n=5) | 0.987 ± 0.002 (n=5) | 49k | 1.7m | trace: output · eval-code · log · train-code · config · W&B |
| fault_detection_local | ieee39 | cnn | balanced_accuracy ↑ | 0.899 ± 0.005 (n=5) | 0.987 ± 0.001 (n=5) | 49k | 2.6m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_global | cigre_mv | cnn | balanced_accuracy ↑ | 0.946 ± 0.007 (n=5) | 0.988 ± 0.005 (n=5) | 124k | 6.8m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_global | double_line | cnn | balanced_accuracy ↑ | 0.971 ± 0.000 (n=5) | 1.000 ± 0.001 (n=5) | 68k | 3.2m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_global | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.969 ± 0.001 (n=5) | 0.999 ± 0.001 (n=5) | 94k | 5.0m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_global | ieee39 | cnn | balanced_accuracy ↑ | 0.967 ± 0.001 (n=5) | 0.961 ± 0.027 (n=5) | 234k | 30.0m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | cigre_mv | cnn | balanced_accuracy ↑ | 0.960 ± 0.008 (n=5) | 0.994 ± 0.004 (n=5) | 51k | 1.2m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | double_line | cnn | balanced_accuracy ↑ | 0.970 ± 0.000 (n=5) | 1.000 ± 0.000 (n=5) | 51k | 2.1m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.969 ± 0.001 (n=5) | 1.000 ± 0.000 (n=5) | 51k | 1.7m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_line | ieee39 | cnn | balanced_accuracy ↑ | 0.970 ± 0.000 (n=5) | 0.999 ± 0.000 (n=5) | 51k | 1.7m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_local | cigre_mv | cnn | balanced_accuracy ↑ | 0.956 ± 0.005 (n=5) | 0.993 ± 0.005 (n=5) | 49k | 1.1m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_local | double_line | cnn | balanced_accuracy ↑ | 0.970 ± 0.001 (n=5) | 0.998 ± 0.002 (n=5) | 49k | 2.1m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_local | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.969 ± 0.001 (n=5) | 0.998 ± 0.001 (n=5) | 49k | 2.2m | trace: output · eval-code · log · train-code · config · W&B |
| fault_grounded_local | ieee39 | cnn | balanced_accuracy ↑ | 0.969 ± 0.001 (n=5) | 0.997 ± 0.001 (n=5) | 49k | 1.3m | trace: output · eval-code · log · train-code · config · W&B |
| fault_location_global | cigre_mv | cnn | mae ↓ | 22.345 ± 0.302 (n=5) | 19.521 ± 0.995 (n=5) | 124k | 3.4m | trace: output · eval-code · log · train-code · config · W&B |
| fault_location_global | double_line | cnn | mae ↓ | 17.771 ± 0.093 (n=5) | 10.106 ± 0.327 (n=5) | 67k | 1.7m | trace: output · eval-code · log · train-code · config · W&B |
| fault_location_global | testgrid_110kv | cnn | mae ↓ | 18.590 ± 0.215 (n=5) | 11.585 ± 0.441 (n=5) | 94k | 3.2m | trace: output · eval-code · log · train-code · config · W&B |
| fault_location_global | ieee39 | cnn | mae ↓ | 21.447 ± 0.374 (n=5) | 27.133 ± 4.908 (n=5) | 234k | 12.9m | trace: output · eval-code · log · train-code · config · W&B |
| fault_location_line | cigre_mv | cnn | mae ↓ | 23.005 ± 0.552 (n=5) | 24.522 ± 4.373 (n=5) | 51k | 1.1m | trace: output · eval-code · log · train-code · config · W&B |
| fault_location_line | double_line | cnn | mae ↓ | 17.841 ± 0.524 (n=5) | 10.421 ± 1.154 (n=5) | 51k | 1.1m | trace: output · eval-code · log · train-code · config · W&B |
| fault_location_line | testgrid_110kv | cnn | mae ↓ | 17.693 ± 0.366 (n=5) | 8.842 ± 1.200 (n=5) | 51k | 1.6m | trace: output · eval-code · log · train-code · config · W&B |
| fault_location_line | ieee39 | cnn | mae ↓ | 20.081 ± 0.231 (n=5) | 13.893 ± 0.551 (n=5) | 51k | 40s | trace: output · eval-code · log · train-code · config · W&B |
| fault_location_local | cigre_mv | cnn | mae ↓ | 23.986 ± 0.110 (n=5) | 30.710 ± 0.117 (n=5) | 49k | 30s | trace: output · eval-code · log · train-code · config · W&B |
| fault_location_local | double_line | cnn | mae ↓ | 19.303 ± 0.179 (n=5) | 15.649 ± 0.432 (n=5) | 49k | 1.6m | trace: output · eval-code · log · train-code · config · W&B |
| fault_location_local | testgrid_110kv | cnn | mae ↓ | 19.727 ± 0.084 (n=5) | 14.990 ± 0.643 (n=5) | 49k | 1.6m | trace: output · eval-code · log · train-code · config · W&B |
| fault_location_local | ieee39 | cnn | mae ↓ | 22.981 ± 0.326 (n=5) | 22.972 ± 0.660 (n=5) | 49k | 58s | trace: output · eval-code · log · train-code · config · W&B |
| fault_origin_global | cigre_mv | cnn | balanced_accuracy ↑ | 0.811 ± 0.020 (n=5) | 0.919 ± 0.035 (n=5) | 124k | 8.6m | trace: output · eval-code · log · train-code · config · W&B |
| fault_origin_global | double_line | cnn | balanced_accuracy ↑ | 0.867 ± 0.010 (n=5) | 0.976 ± 0.019 (n=5) | 68k | 2.6m | trace: output · eval-code · log · train-code · config · W&B |
| fault_origin_global | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.886 ± 0.010 (n=5) | 0.974 ± 0.016 (n=5) | 94k | 5.1m | trace: output · eval-code · log · train-code · config · W&B |
| fault_origin_global | ieee39 | cnn | balanced_accuracy ↑ | 0.860 ± 0.006 (n=5) | 0.951 ± 0.024 (n=5) | 234k | 21.5m | trace: output · eval-code · log · train-code · config · W&B |
| fault_phase_global | cigre_mv | cnn | balanced_accuracy ↑ | 0.837 ± 0.003 (n=5) | 0.977 ± 0.004 (n=5) | 125k | 9.0m | trace: output · eval-code · log · train-code · config · W&B |
| fault_phase_global | double_line | cnn | balanced_accuracy ↑ | 0.865 ± 0.003 (n=5) | 0.984 ± 0.002 (n=5) | 68k | 3.3m | trace: output · eval-code · log · train-code · config · W&B |
| fault_phase_global | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.874 ± 0.017 (n=5) | 0.980 ± 0.002 (n=5) | 95k | 5.6m | trace: output · eval-code · log · train-code · config · W&B |
| fault_phase_global | ieee39 | cnn | balanced_accuracy ↑ | 0.837 ± 0.003 (n=5) | 0.880 ± 0.065 (n=5) | 235k | 19.1m | trace: output · eval-code · log · train-code · config · W&B |
| fault_phase_line | cigre_mv | cnn | balanced_accuracy ↑ | 0.850 ± 0.003 (n=5) | 0.975 ± 0.001 (n=5) | 52k | 1.4m | trace: output · eval-code · log · train-code · config · W&B |
| fault_phase_line | double_line | cnn | balanced_accuracy ↑ | 0.878 ± 0.002 (n=5) | 0.986 ± 0.001 (n=5) | 52k | 2.1m | trace: output · eval-code · log · train-code · config · W&B |
| fault_phase_line | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.886 ± 0.003 (n=5) | 0.984 ± 0.002 (n=5) | 52k | 1.9m | trace: output · eval-code · log · train-code · config · W&B |
| fault_phase_line | ieee39 | cnn | balanced_accuracy ↑ | 0.893 ± 0.001 (n=5) | 0.984 ± 0.001 (n=5) | 52k | 1.7m | trace: output · eval-code · log · train-code · config · W&B |
| fault_phase_local | cigre_mv | cnn | balanced_accuracy ↑ | 0.854 ± 0.002 (n=5) | 0.972 ± 0.003 (n=5) | 49k | 1.4m | trace: output · eval-code · log · train-code · config · W&B |
| fault_phase_local | double_line | cnn | balanced_accuracy ↑ | 0.881 ± 0.003 (n=5) | 0.984 ± 0.002 (n=5) | 49k | 1.9m | trace: output · eval-code · log · train-code · config · W&B |
| fault_phase_local | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.883 ± 0.023 (n=5) | 0.981 ± 0.006 (n=5) | 49k | 1.7m | trace: output · eval-code · log · train-code · config · W&B |
| fault_phase_local | ieee39 | cnn | balanced_accuracy ↑ | 0.897 ± 0.001 (n=5) | 0.983 ± 0.003 (n=5) | 49k | 1.6m | trace: output · eval-code · log · train-code · config · W&B |
| switch_detection_global | cigre_mv | cnn | balanced_accuracy ↑ | 0.781 ± 0.012 (n=5) | 0.822 ± 0.014 (n=5) | 124k | 37.9m | trace: output · eval-code · log · train-code · config · W&B |
| switch_detection_global | double_line | cnn | balanced_accuracy ↑ | 0.729 ± 0.025 (n=5) | 0.816 ± 0.017 (n=5) | 68k | 10.6m | trace: output · eval-code · log · train-code · config · W&B |
| switch_detection_global | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.694 ± 0.021 (n=5) | 0.823 ± 0.002 (n=5) | 94k | 21.8m | trace: output · eval-code · log · train-code · config · W&B |
| switch_detection_global | ieee39 | cnn | balanced_accuracy ↑ | 0.783 ± 0.011 (n=5) | 0.769 ± 0.044 (n=5) | 234k | 1.7h | trace: output · eval-code · log · train-code · config · W&B |
| switch_type_global | cigre_mv | cnn | balanced_accuracy ↑ | 0.726 ± 0.005 (n=5) | 0.782 ± 0.016 (n=5) | 125k | 12.4m | trace: output · eval-code · log · train-code · config · W&B |
| switch_type_global | double_line | cnn | balanced_accuracy ↑ | 0.710 ± 0.006 (n=5) | 0.678 ± 0.036 (n=5) | 68k | 3.9m | trace: output · eval-code · log · train-code · config · W&B |
| switch_type_global | testgrid_110kv | cnn | balanced_accuracy ↑ | 0.729 ± 0.003 (n=5) | 0.739 ± 0.007 (n=5) | 95k | 5.6m | trace: output · eval-code · log · train-code · config · W&B |
| switch_type_global | ieee39 | cnn | balanced_accuracy ↑ | 0.682 ± 0.011 (n=5) | 0.231 ± 0.030 (n=5) | 235k | 12.9m | trace: output · eval-code · log · train-code · config · W&B |
Dependability/security rates and per-class F1 for this baseline — the same held_out result.json cells the Supplementary (Package C) tables select, traced here so every reported SI number resolves on the dashboard.