Skip to content

CI: Report SBML simulation and sensitivity checks independently - #3254

Merged
dweindl merged 1 commit into
AMICI-dev:mainfrom
dweindl:backport-sbml-split-reporting
Sep 8, 2026
Merged

CI: Report SBML simulation and sensitivity checks independently#3254
dweindl merged 1 commit into
AMICI-dev:mainfrom
dweindl:backport-sbml-split-reporting

Conversation

@dweindl

@dweindl dweindl commented Sep 7, 2026

Copy link
Copy Markdown
Member

Preparation for #3253:

Split test_sbml_testsuite_case into separate simulation and sensitivity test nodes, sharing one session-scoped model setup fixture so the model is still compiled only once per case. This enables separately skipping/reporting the sensitivity check results.

Requires --dist=loadgroup wherever this suite runs with -n, so both nodes for a case stay on the same xdist worker -- otherwise they will import the model twice and race on the same on-disk model directory.

@dweindl dweindl self-assigned this Sep 7, 2026
@codecov

codecov Bot commented Sep 7, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 78.55%. Comparing base (db1eff9) to head (9315a83).

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             main    #3254      +/-   ##
==========================================
- Coverage   78.57%   78.55%   -0.02%     
==========================================
  Files         318      318              
  Lines       22248    22248              
  Branches     1491     1491              
==========================================
- Hits        17482    17478       -4     
- Misses       4758     4762       +4     
  Partials        8        8              
Flag Coverage Δ
cpp 72.35% <ø> (-0.02%) ⬇️
cpp_python 35.17% <ø> (ø)
petab 48.31% <ø> (ø)
petab_sciml 16.40% <ø> (ø)
petab_sciml_benchmarks 14.96% <ø> (ø)
python 70.80% <ø> (-0.01%) ⬇️
sbmlsuite-jax 31.55% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.
see 3 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Split test_sbml_testsuite_case into separate simulation and
sensitivity test nodes, sharing one session-scoped fixture so the
model is still compiled only once per case. A case whose simulation
is correct but whose sensitivities aren't (yet) checkable no longer
gets misreported as an overall failure/skip.

Requires --dist=loadgroup wherever this suite runs with -n, so both
nodes for a case stay on the same xdist worker -- otherwise they
will import the model twice and race on the same on-disk model
directory.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
@dweindl
dweindl force-pushed the backport-sbml-split-reporting branch from 5b9adc0 to 9315a83 Compare September 8, 2026 04:29
@dweindl
dweindl marked this pull request as ready for review September 8, 2026 05:37
@dweindl
dweindl requested a review from a team as a code owner September 8, 2026 05:37
@dweindl
dweindl added this pull request to the merge queue Sep 8, 2026
Merged via the queue into AMICI-dev:main with commit 4c400ae Sep 8, 2026
37 of 38 checks passed
@dweindl
dweindl deleted the backport-sbml-split-reporting branch September 8, 2026 07:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants