perf: qualify range and index roadmap experiments - #19
Merged
Conversation
josephjohncox
force-pushed
the
perf/roadmap-experiments
branch
from
July 22, 2026 09:14
d8d995a to
7abab6a
Compare
CI checks out a shallow clone, so `git show <baseline-commit>:...` for the pinned pre-segmentation commit failed with exit 128. Fetch that commit by SHA on demand (GitHub permits reachable-SHA fetches) and skip with a clear reason only when it is genuinely unavailable (offline), instead of hard-failing.
This was referenced Jul 22, 2026
Merged
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Runs the six-area performance roadmap as bounded, evidence-gated experiments and lands only the changes that passed their fixed, pre-registered gates. Failed runtime candidates are deleted rather than shipped behind loosened thresholds. Adds concrete
ExactBatchRangeSetandBoxIndexexamples, and hardens every experiment verifier against forged evidence.The canonical stable API (
RangeSet,create_range_set,BackendRegistry), exact-batch geometry, payload algebra, atomicity, and all existing gates are unchanged.Accepted into the runtime (2)
RangeSnapshotcache (treemendous/rangeset.py): reuses one immutable snapshot while geometry is unchanged and no payload policy is set; payload-bearing snapshots still clone/detach exactly as before. 40-block confirmation: unchanged N=10 000 upper-95 0.00057 (≤0.25), cached N=10000/N=1000 median 0.958 (≤1.50), worst write-then-observe upper-95 1.035 (≤1.10). Scalar-mutation regression vs. immutable baseline: median 0.98 (100 samples).treemendous/applications/_shared/leasing.py,leasing/_common.py, Candidate B): direct token lookup with zero public snapshots and zero linear scans; lazy immutable projections invalidated on publication. 30-block: fence upper-95 0.177, repeated-snapshot N=8192 upper-95 0.266 (both ≤0.50).Rejected and removed (deletion, not gate-weakening)
RangeSet.mutate_manytransaction (E2)BackendAdapterhas no atomic state-replacement primitive. No method/protocol/export added.cpp_boundaryconfirmed faster, but current-defaultpy_boundaryupper-95 hit 1.125 onpool_group(≤1.10 default-stability gate). No injection retained.BoxIndexfor RadioSpectrum (E6)BoxIndex(2).New executable examples
atomic_memory_map_updates,atomic_partition_availability_updates,genomic_mask_batch_updateswarehouse_space_time_reservations(3D),video_region_timeline_overlap(3D),robot_volume_time_conflicts(4D)All are registered in
examples/README.mdand executed from an unrelated CWD bytests/docs/test_readme.py.Diagnostic evidence (informative only)
ExactBatchRangeSetbeats scalarcpp_boundaryreplay from B=1 at N≤1000 across all shapes, but loses at N=10 000 (1.1–3.6×) — the O(N) full-state copy E3 tried and failed to remove.tests/performance/experiments/fixtures/exact_batch_segmented_tuned.patch) plus an archived triplet underdocs/evidence/experiments/, bound by source/binary/patch SHA-256 and verifiable offline (just verify-exact-batch-storage-archive).Verifier hardening
Every experiment verifier rejects fabricated runtime/build/backend provenance, bool/int and int/float coercion, duplicate keys, non-canonical JSON, and relabeled/duplicated matrix rows. The snapshot benchmark's order-confounded pooled analysis was replaced with pre-registered balanced AB/BA blocks and whole-block bootstrap.
Boundaries preserved
tests/performance/experiments/; no stable package API, ABI, or gate changed.Validation
just check(layout, scenarios, Ruff, format, mypy, full pytest + coverage, packaging/docs, bytecode) passed locally.Experiment matrices are machine-specific diagnostics; accepted-runtime decisions rest on the fixed gates above, not on any single headline number.