Skip to content

feat: ingest authorized real Chongqing feature slice - #41

Open
zhouning wants to merge 1 commit into
feat/ar1-metadata-fabric-object-store-active-metadata-promotionfrom
feat/ar1-metadata-fabric-real-feature-ingestion
Open

feat: ingest authorized real Chongqing feature slice#41
zhouning wants to merge 1 commit into
feat/ar1-metadata-fabric-object-store-active-metadata-promotionfrom
feat/ar1-metadata-fabric-real-feature-ingestion

Conversation

@zhouning

Copy link
Copy Markdown
Owner

Summary

  • ingest the checked 20-feature Chongqing cultural-district bundle through one plan- and authorization-bound Spark 3.5.0 / Sedona 1.9.0 Job
  • create an independent output ResourceVersion candidate with exact row-set, Iceberg schema, quality, artifact and lineage bindings
  • commit path-free local evidence, ADR-068, CI validation, runtime inventory and roadmap/System-of-Record updates

Live evidence

  • all six Sedona quality counts are 20
  • first execution appended exactly once with one snapshot and one 20-row Parquet file
  • immediate replay is no_op with zero mutations and identical row/snapshot/file readback
  • direct S3 inventory is 1 data + 2 metadata + 2 manifest objects
  • evidence SHA: 42abd82613eaf28cb53c64280258bc75dba6cf841f9a513a4c801a9f798b9899
  • namespace, PVs and port-forwards were fully cleaned

Verification

  • metadata-fabric-real-feature-ingestion.sh validate
  • focused dependency/contract regression: 85 passed
  • required-platform suite: 882 passed
  • Ruff passes for the new implementation and tests

Boundaries

  • source paths, BSM values, WKB payloads and credentials are absent from committed evidence
  • output candidates are not persisted to GDA Control and the PlatformRun is not finalized
  • protected identity, production object storage, production ingestion and production readiness remain false

Closes #40

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant