Skip to content

ME-RV-081 — Held-out external benchmark #43

Open
Open
ME-RV-081 — Held-out external benchmark#43
Labels
P1Priority oneme-rvMathEvidence real-vision closure issueswave-8Real-vision Wave 8: Foundry/governance/adoption
Milestone
Wave 8 — Foundry, federation, and governance

Description

@fraware
fraware
opened on Jul 26, 2026

Summary

External-project held-out set with permissions + provenance (>=20 library-derived slots).

Normative: 10_FOUNDRY_BENCHMARKS_AND_FEDERATION.md (ME-RV-081)

Status: BLOCKED(human) — 0 / 20 slots filled. Do not invent completions.

Fillable package

  • docs/validation/held-out-external-benchmark.md (A01-A05, B01-B05, C01-C05, D01-D05)
  • Index: docs/validation/human-gates-runbook.md
  • Issue form: .github/ISSUE_TEMPLATE/held_out_benchmark.yml

Acceptance

  • >=5 Mathlib-derived algebra with permissions + provenance
  • >=5 SciLean/Physlib analytic with permissions + provenance
  • >=5 CSLib/finite with permissions + provenance
  • >=5 independent contributor problems with permissions + provenance
  • Not copied examples claimed as adoption (see ME-RV-086)

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    P1Priority oneme-rvMathEvidence real-vision closure issueswave-8Real-vision Wave 8: Foundry/governance/adoption

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions