Add project page (GitHub Pages, /docs) - #2
Open
rustnew wants to merge 4 commits into
Open
Conversation
…indings Self-contained static HTML (docs/index.html, no build step, .nojekyll to serve it as-is) -- a single landing page presenting the same three findings as the README (jacob_cov as best-evidenced method, the rho=0.670->0.395 correction, the Xavier/He scale-invariance bug) for readers arriving from a link rather than the repo directly. Every number and link on the page matches the README/reports exactly, no new claims. README: added the project-page link once GitHub Pages is enabled (Settings -> Pages -> branch main, /docs -- not yet turned on, see PR description).
|
Important
This repository does not receive automatic reviews because it has fewer than 10 stars. ⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Team Run ID: Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
…ction - White background, sans-serif, restrained accent color -- cleaner and more in line with the project's own emphasis on evidence over presentation than the previous cream/serif academic-paper look. - New section linking karpathy/autoresearch: not a claim of affiliation or equivalence (different problem -- autonomous training-code agent vs pre-training hyperparameter prediction), but an honest nod to the same underlying bet, tight/cheap experimental loops run fast and logged honestly, wins and failures alike.
Requested framing: show readers the concrete practical benefit, not just proxy-correlation numbers. Added to both the project page and README, using two real, verified cases from the locked test set (not hypothetical): one task where 2 of 3 init choices never converge within budget and our pick is the one that does (627 vs 1600 steps), another where our pick needs 61 steps against 208 for the worst choice (3.4x). Both explicitly framed as real wins, not the average case (47% overall). Also explicitly corrects a 'less data' framing: that's a different claim this project tested directly (active sample selection, source.md pillar 6) and found negative (0/12 tasks, -267.6% worse). Restored precog/active_learning.py, scripts/explore_active_learning.py and its report from the full project (previously excluded as 'abandoned exploratory code') since the page now cites it as evidence for what this project does NOT demonstrate -- added to CI so that claim stays honest too.
Requested: make sure every research method/hypothesis used has a link, not just a name-drop. Verified every arXiv ID via search before linking (never guessed one) -- NASWOT 2006.04647, NEAR 2408.08776, ZiCo 2301.11300, AZ-NAS 2403.19232, SynFlow 2006.05467, SNIP 1810.02340, GraSP 2002.07376, LSUV 1511.06422. - New 'References' section on the project page: every method used, linked to the original paper, with what it was used for. - README: inline links for every method mentioned (was name-only before). - source.md: fixed 2 real gaps found doing this -- ZiCo and AZ-NAS were used directly in scripts/gate1_ranking.py but never appeared in the bibliography at all; NASWOT and NEAR were named without any link; SynFlow/SNIP/GraSP/LSUV were only cited via the survey paper that benchmarks them, not their own original papers. - Restored scripts/explore_lsuv_init.py and its report (previously excluded as 'abandoned exploratory code') since source.md and the page's References table now cite it as evidence -- every claim needs a script behind it, added to CI so it stays that way.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changed and why
Adds
docs/index.html, a self-contained static landing page for GitHubPages, so the project has a link that isn't "go read a README on GitHub" --
useful for sharing outside GitHub (e.g. the Reddit posts prepared for
r/LocalLLaMA, r/LLMDevs, r/learnmachinelearning, r/ArtificialIntelligence).
Also adds the page's link to the README once Pages is enabled.
Evidence
Not a results/code change -- pure presentation, no new claim. Every
number and finding on the page is copied verbatim from the README /
results/reports/*.md, not recomputed or restated differently:47% / baseline 38%, regret table ->
results/reports/...compare_meta_predictors.mdrho 0.670 -> 0.395 correction ->
results/reports/...gate1_ranking_at_scale.mdXavier/He 0.0 difference ->
results/reports/...explore_scale_invariance_blindspot.mdN/A (presentation-only PR) -- see note above instead of a script run.
No claim on the page differs from the README/reports it's copied from.
N/A -- no negative result introduced here.
Checklist
reproduce.yml) passes on this branch.data/meta_dataset.dbnot touched.Open questions / requested feedback
GitHub Pages itself is not yet enabled on the repo (Settings → Pages →
source: branch
main, folder/docs) -- that's a repo-setting changeoutside this diff's scope, needs to happen once this merges for the
rustnew.github.io/precog-trainability/link in the README to resolveinstead of 404ing. Flagging so it isn't forgotten post-merge.