Skip to content

Remove the V1 catalog-test machinery - #3419

Merged
jgraettinger merged 2 commits into
masterfrom
johnny/v2-tests-5-remove-v1
Sep 2, 2026
Merged

Remove the V1 catalog-test machinery#3419
jgraettinger merged 2 commits into
masterfrom
johnny/v2-tests-5-remove-v1

Conversation

@jgraettinger

@jgraettinger jgraettinger commented Aug 27, 2026

Copy link
Copy Markdown
Member

Description:

Stack 5 of 5, and pure deletion. Nothing drives the V1 catalog-test machinery any more: CI runs on catalog-tests as of #3417, and publication tests as of #3418.

Two commits, kept separate so ~2,950 lines of proto regen don't bury the hand-written Go deletions:

  • go: remove the V1 catalog-test machinery
  • proto: remove the Testing RPC service

Workflow steps:

flowctl-go test, flowctl-go api test, and flowctl-go temp-data-plane no longer exist. Use flowctl raw test --source ... (#3417).

Documentation links affected:

None.

Notes for reviewers:

Read the first commit; the second is almost entirely regenerated code.

One flag worth a second look. FlowConsumerConfig.Flow.TestAPIs / --flow.test-apis is removed along with the pf.RegisterTestingServer block it gated. It also gated something non-obvious: control-plane construction was skipped when it was set, because a temp data plane has no control plane to talk to. Only temp-data-plane ever passed the flag, so for every real consumer that term was already true and dropping it changes nothing.

The Testing service's three RPCs are all superseded — ResetState by derive.Request.Reset, AdvanceTime by a counter inside catalog-tests, and Ingest by a combine-by-key and an append to an in-memory collection store. derive.Request.Reset itself stays in the connector protocol: it is the mechanism the V2 flow now drives.


Stack — each PR is based on the one above it, so review only the top commits of each.

  1. Housekeeping and prep for the catalog-test harness #3415 — Housekeeping and prep (merged)
  2. runtime-local: extract the local task-drive layer from flowctl #3416 — runtime-local: extract the local task-drive layer
  3. catalog-tests: the catalog test harness, and flowctl raw test #3417 — catalog-tests: the harness, and flowctl raw test
  4. control-plane-api: run publication tests on catalog-tests #3418 — control-plane-api: run publication tests on catalog-tests
  5. Remove the V1 catalog-test machinery #3419 — Remove the V1 catalog-test machinery ← you are here

@jgraettinger
jgraettinger requested a review from a team August 27, 2026 00:25
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-4-publication-tests branch from 473159e to 4d689b9 Compare August 30, 2026 17:56
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-5-remove-v1 branch from 846d282 to 41b8bff Compare August 30, 2026 17:56
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-4-publication-tests branch from 4d689b9 to 12b25e5 Compare August 30, 2026 18:08
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-5-remove-v1 branch from 41b8bff to 1848274 Compare August 30, 2026 18:09
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-4-publication-tests branch from 12b25e5 to 893de73 Compare August 31, 2026 22:08
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-5-remove-v1 branch from 1848274 to a3d85b3 Compare August 31, 2026 22:08
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-4-publication-tests branch from 893de73 to a7bf70c Compare August 31, 2026 22:19
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-5-remove-v1 branch from a3d85b3 to d36abab Compare August 31, 2026 22:19
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-4-publication-tests branch from a7bf70c to a3a147b Compare August 31, 2026 22:46
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-5-remove-v1 branch from d36abab to c10a65d Compare August 31, 2026 22:46
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-4-publication-tests branch from a3a147b to e99bf9f Compare September 1, 2026 00:51
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-5-remove-v1 branch from c10a65d to ad136ad Compare September 1, 2026 00:51
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-4-publication-tests branch from e99bf9f to 5727a84 Compare September 1, 2026 01:34
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-5-remove-v1 branch from ad136ad to f66cad3 Compare September 1, 2026 01:34
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-4-publication-tests branch from 5727a84 to 8c84db4 Compare September 1, 2026 04:46
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-5-remove-v1 branch from f66cad3 to 9048fea Compare September 1, 2026 04:46
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-4-publication-tests branch from 8c84db4 to d7b8fb9 Compare September 1, 2026 15:34
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-5-remove-v1 branch from 9048fea to 15efed1 Compare September 1, 2026 15:34
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-4-publication-tests branch from d7b8fb9 to f53a04b Compare September 1, 2026 16:17
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-5-remove-v1 branch from 15efed1 to 19ea1a2 Compare September 1, 2026 16:17
williamhbaker
williamhbaker previously approved these changes Sep 1, 2026

@williamhbaker williamhbaker left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-4-publication-tests branch from f53a04b to 875f483 Compare September 1, 2026 21:43
Base automatically changed from johnny/v2-tests-4-publication-tests to master September 2, 2026 13:40
@jgraettinger
jgraettinger dismissed williamhbaker’s stale review September 2, 2026 13:40

The base branch was changed.

Nothing drives it any more: CI and publication tests both run on `catalog-tests`
as of the preceding commits.

Deleted: `flowctl-go test`, `flowctl-go api test`, and `flowctl-go
temp-data-plane`; `sys_proc_attr_{linux,bsd}.go`, whose `SysProcAttr` had exactly
one caller in temp-data-plane; `go/runtime/testing.go`; and all of `go/testing/`
— the graph, clock, action, and cluster driver, whose semantics now live in
`crates/catalog-tests` as a Rust port. `deriveApp.ClearRegistersForTest` goes
with its sole caller there.

`FlowConsumerConfig.Flow.TestAPIs` and the `--flow.test-apis` flag are removed,
along with the `pf.RegisterTestingServer` block they gated. The flag also gated
control-plane construction, which was skipped when it was set because a temp data
plane has no control plane to talk to; only temp-data-plane ever passed the flag,
so for every real consumer that term was already true.

`derive.Request.Reset` stays in the connector protocol — it is the mechanism the
V2 flow now drives.
The last implementation went away in the preceding commit, so the definition can
follow: `ResetStateRequest`/`Response`, `AdvanceTimeRequest`/`Response`,
`IngestRequest`/`Response`, and the `Testing` service itself.

Its three RPCs are all superseded. ResetState is now `derive.Request.Reset`,
driven shard-locally by the runtime. AdvanceTime is gone entirely — synthetic
test time is a counter inside `catalog-tests`, not something a data plane
advances. Ingest is a combine-by-key and an append to an in-memory collection
store.

Kept separate from the previous commit so that ~2,950 lines of generated churn
across flow.pb.go, proto-flow, and proto-grpc don't bury the hand-written
deletions there.
@jgraettinger
jgraettinger force-pushed the johnny/v2-tests-5-remove-v1 branch from 19ea1a2 to a358445 Compare September 2, 2026 14:33
@jgraettinger
jgraettinger merged commit 1f043bc into master Sep 2, 2026
11 checks passed
@github-actions github-actions Bot added the pending:agent Merged, in the control-plane-agent image, and not yet rolled to flow-agent label Sep 2, 2026
@jgraettinger
jgraettinger deleted the johnny/v2-tests-5-remove-v1 branch September 2, 2026 16:40
@github-actions github-actions Bot added pending:flowctl Merged, changes the flowctl binary, and not in a published release pending:agent-api Merged, ships via Deploy agent-api, and not yet deployed labels Sep 2, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pending:agent Merged, in the control-plane-agent image, and not yet rolled to flow-agent pending:agent-api Merged, ships via Deploy agent-api, and not yet deployed pending:flowctl Merged, changes the flowctl binary, and not in a published release

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants