Interactivity on 100GB+ datasets: O(change) view sync and ledger writes - #303

Open

AlexGrayBox wants to merge 16 commits into

devfrom

feat/interactivity-100gb-datasets

Commits on Aug 19, 2026

docs(perf): register O(data) operations blocking 100GB+ interactivity
Alexandru Rotaru
committed
b26f010
docs(perf): triage every _slowUpdateInternals call site
Alex Rotaru
committed
83a67e2
perf(interactivity): make view refresh and ledger writes O(change)

Alexandru Rotaru
and
claude
committed
999e859
fix(view): stop the served view silently diverging from the ledger

Alexandru Rotaru
and
claude
committed
cf0397d
fix(histogram): bin over rows that carry a value, not every row in the view

Alexandru Rotaru
and
claude
committed
9466dc1
fix(ledger): make the NB_SEEN lookup O(batch), and regenerate the protos

Alexandru Rotaru
and
claude
committed
2c37d71
fix(data_service): bin the numeric histogram over the whole view again

Alexandru Rotaru
and
claude
committed
0ef0a1c
Merge remote-tracking branch 'origin/dev' into feat/interactivity-100gb-datasets
Alex
committed
8944304
proto: regenerate with package-relative imports after the dev merge

Alex
and
claude
committed
53ac28a

Commits on Aug 20, 2026

Merge origin/dev into feat/interactivity-100gb-datasets
Alexandru Rotaru
committed
40c7a53
fix(logger): import deque alongside defaultdict

Alex
and
claude
committed
ac608f6
fix(shapes): keep the label cache on top of dev write_signal_shapes

Alex
and
claude
committed
70cadde

Commits on Aug 21, 2026

fix(signals): restore inputs= on the batched subscribe_to path

Alex
and
claude
committed
da35366
Remove optrace tracing from weightslab

Alex
and
claude
committed
a360234

Commits on Sep 3, 2026

ci: fix the code-quality and gRPC-test failures on this branch

Alexandru Rotaru
and
claude
committed
00443e2

Commits on Sep 4, 2026

Merge branch 'dev' into feat/interactivity-100gb-datasets
guillaume-byte
authored
24990ae