Engineering evidence, reproducibility, and scalability records for STAR / StarBench.
STAR Lab is intentionally separate from the production/runtime repository.
star-nexus/staris the product and benchmark repository. Users should normally usemainthere.star-nexus/star-labis the engineering research archive: reproducible problem reports, controlled experiments, raw evidence, root-cause analyses, engineering decisions, and the historical STAR Performance Frontier.
The core rule is simple:
Every important engineering conclusion must be traceable from the claim, to raw evidence, to a reproducible experiment, to an exact
starcommit or immutable tag.
For the active 10K work, read the recovery entry. P0 archive and exact-source recovery preserve retired experiments.
- Read
PROTOCOL.mdbefore adding a formal experiment. - Create new experiment packages from
templates/. - Preserve only evidence that supports a durable engineering conclusion.
- Bind every formal experiment to exact
star-nexus/starcommit SHA(s); never rely on a moving branch name alone. - Update
records/performance-frontier.mdonly for validated frontier results.
star-lab/
├── README.md
├── PROTOCOL.md
├── templates/
│ ├── experiment-readme.md
│ ├── manifest.yaml
│ ├── analysis.md
│ └── decision.md
├── experiments/
├── investigations/
├── decisions/
└── records/
└── performance-frontier.md
star branch = active work line
star checkpoint = temporary comparison / debugging baseline
star annotated tag= validated immutable engineering milestone
star-lab = reproducible evidence and decision history
STAR Lab does not maintain a production source fork. The P0 archival bundle preserves retired experiment refs for recovery. It has its own Git history and references STAR source states through exact commit SHAs and tags.