Skip to content

Published-skills factual sweep: verify every behavioral claim in skills/** against the implementation — program anchor #13658

Description

@zhuangjianguo

Program anchor, filed by the skills lane seat (session session_01EXxTW8mvPBhoHxmyPZ63de) on the maintainer's scheduling order.

Mandate (verbatim)

2026-08-31, chat: 「指对外发布的 skills/**,也需要排程」 — confirming the program proposed after PR #13577. Standing context, 2026-08-21: 「对外发布的 skills 是整个平台的最大价值」.

Why a sweep, not more incidents

The published corpus has token/line ratchets (scripts/check-skills-token-ratchet.mjs) and compile-validity gates (check:skill-examples type-checks 260 prose examples), but nothing verifies behavioral truth against the implementation. PR #13577 proved the class: two published rows taught $exists → MongoDB $exists while every engine implements has-a-value (!= null) — found incidentally by an unrelated card, not by any sweep. One measured false row in ~186k published tokens is a floor, not a ceiling.

Method — PR #13577 is the spec

Per behavioral claim (operator/API table rows, key names, behavioral sentences, code examples' asserted outputs):

  1. Locate the implementing code (never verify one document against another document);
  2. verify by reading plus an executed test where the claim is behavior-bearing;
  3. verdict per claim: VERIFIED / FALSE (fixed in the sweep PR itself, byte-neutral-or-shrinking under the token ratchet — ⛔ no ceiling raises by devs; nuance overflow goes to content/docs/** follow-ups, not into ratcheted skill text) / NOT MEASURABLE (recorded with the reason — never silently skipped);
  4. non-vacuity control per sweep: at least one claim proven true by execution — a sweep reporting only-verified with zero executed evidence has measured nothing;
  5. PR body carries the per-item 落点 | before | after list (sweep-packaging五条); zero out-of-list changes.

Inventory and order

# package .md lines note
objectstack-formula 579 calibration flight — measures cost-per-claim and false-density to size the rest
objectstack-data 4,935 largest; same semantic family as the proven false row; split-by-file allowed with report
objectstack-query 1,550 ⛔ serial behind PR #13577's merge (same files)
objectstack-platform 2,633
objectstack-ui 2,298
objectstack-automation 1,163
⑦–⑪ api 707 · i18n 807 · upgrade 696 · ai 691 · pm-dispatch 1,077
objectui skills/objectui 5,686 merge regime pending the ui#6866 half-1 ruling; until ruled, governed posture (the fleet-side default)

Batching: one flight per package, ≤3 parallel, no file overlap. All objectstack skills/** PRs: governed — draft, human merge.

Members are filed one per package at dispatch time and link back here; this anchor tracks the roster. First calibration results re-size the schedule and get posted here.

Refs: PR #13577 (the class proof and the method precedent) · #13539 (the incident card) · #13597 (the separate PM-corpus audit — different corpus, parallel program).

Generated by Claude Code

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions