feat(domain): add autoregressive solver-loop curriculum - #124
Closed
andrinr wants to merge 5 commits into
Closed
Conversation
Contributor
📊 View the full benchmark resultsNo benchmarks ran for this PR, so there is no status report. |
Collaborator
Author
|
Folded into #118. The full solver-in-loop curriculum implementation is now on that draft PR; the ongoing offline Kander runs and their aggregated plots/GIFs will be reported there. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
State of this PR
This stacked follow-up turns the compact temporal-credit audit in #116 into a
paper-aligned autoregressive correction study. It keeps the existing
optimization/solver_in_loopexperiment unchanged and adds the opt-inoptimization/solver_in_loop_curriculumexperiment.The new experiment separates three training protocols while holding the
solver, corrector architecture, data, optimiser schedule, and free-running
evaluation fixed:
in the backward pass;
differentiation through the solver.
Protocol
dt=0.02);1 → 2 → 4 → 8 → 16 → 32look-ahead curriculum;used by feat(domain): benchmark all differentiable solvers in the loop #116;
The output separates the gain from recurrent state exposure (
NOG / ONE) fromthe incremental gain from temporal solver gradients (
WIG / NOG). It alsorecords curriculum checkpoint quality, a five-scale per-seed FD/AD sweep, update and wall-clock cost, correlation
horizon, energy/enstrophy/divergence diagnostics, final energy spectra, full
fields, and a five-column reference/solver/ONE/NOG/WIG rollout GIF.
Validation
optimisation, changed learning rates, ONE/NOG/WIG rollout arrays,
correlations, checkpoint shapes, and rendering.
Offline results
Production results are pending. All numerical experiments will run offline on
Kander through the same Slurm/Pyxis runner and solver images used by #116. No
hosted benchmark label will be used.
Literature correspondence
The terminology follows the controlled ONE/NOG/WIG comparison in
Differentiability in Unrolled Training of Neural Physics Simulators
and the recurrent SOL_n protocol in
Solver-in-the-Loop.