Environment & determinism

benchmark version 1.1.0 · held_out results v1.0.0 · splits v1.0/held_out, v1.1/multi_grid
updated 2026-09-29 13:18 UTC · git 7243f310ddbc

Hardware

RoleMachineUsed for
GPU sweepsNHR@FAU Alex — 1× NVIDIA A40 per job (SLURM a40 partition)deep baselines (mlp/gru/cnn/resnet), 24 h wall per grid sweep (hpc/sweep.sh)
Classical baselinesNHR@FAU Alex — A40 MIG slicemajority/threshold/random_forest sweeps auto-routed by hpc/submit.sh
Login nodecluster frontend (no compute)submission, git, log reads, deterministic re-rendering only

Determinism & seeds

Every cell aggregates seeds 0–4 (5 seeds); results report mean ± 95% CI half-width (Student t, ddof=1). What is and is not bit-reproducible is documented in docs/determinism.md.

Window memmaps are staged to node-local $TMPDIR before training; sidecar manifests (feature hash, shape, contract fingerprint) travel with the data and are re-verified at load time.

Pins

What the run records say

Aggregated at build time from every run_record.json under outputs/ — the audit reads the records, it does not assert them.

run records1876
with no-tuning attestation1876
distinct git SHAs011ee01cd33f0007571994d4e1172901d33b1448, 055c212302bc0a5a9ae44ae7e1ad7b085e2c7450, 0740bad210eef4786ee220d6d2b74b5767960491, 097d7505e0a46f1ab85e0a209112398c3b97f45d, 09a30596a0316e1ed7c7b8a2ecfe4fa41756e7e2, 0dacb15beb0f7052423033d9e731417a8b6a65d5, 13f8cdac87378b21f935ec3355b5d3452d15454a, 15eec5ba46f8ba35f3fafd803333066ce6ac3038 …
distinct lockfile SHAs2685c1c2c60b595a…
agree with the results-env capture1876 of 1876 (every record's own captured versions match)
python versions3.12.13
torch versions2.6.0+cu124
recorded hostsa0122, a0123, a0124, a0125, a0224, a0226, a0227, a0228, a0229, a0321, a0323, a0325, a0422, a0423, a0424, a0425, a0427, a0521, a0605, a1622, a1722