bench: Drop the formal-conjectures compile benchmark - #609
Merged
Conversation
arthurpaulino
approved these changes
Sep 2, 2026
samuelburnham
force-pushed
the
sb/drop-compilefc
branch
from
September 2, 2026 16:42
52fc4f7 to
978e678
Compare
samuelburnham
enabled auto-merge
September 2, 2026 16:42
formal-conjectures is a corpus of conjectures, not of proofs, so compiling it measures the compiler against statements nobody has proved. That is not what the compile benchmarks are for. CompileFC existed only to build it: a package whose sole dependency was formal-conjectures, held at Lean v4.27.0 because the upstream corpus targets that release. That stale pin was the one thing the nightly lean-update sweep kept finding to move (#608). Its FC matrix entry in the benchmark workflow has been commented out since it fell behind, so nothing in CI loses a job here. With the pin gone, `. Benchmarks/**` sweeps a tree whose packages all track the current toolchain, so lean-update needs no steering around it.
samuelburnham
force-pushed
the
sb/drop-compilefc
branch
from
September 2, 2026 20:58
978e678 to
3b45554
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.