eval: freeze import-safe retrieval parity v5 - #227
Merged
lipluscodex merged 1 commit intoSep 10, 2026
Conversation
repository rootからambient PYTHONPATHなしで起動できる自己完結runnerを追加する。 v4の93文書とpath prefixを複製せずbyte-exact参照し、固定query、gold、gate、request、metricの意味を維持する。v1-v4の既存protocolと観測証拠をhash監査し、v5 registryはresult-freeのまま専用pathへ分離する。 clean environment smokeはGitHub RAG request、NGR search、SQLite open、artifact createを0件で検証する。性能観測と登録queryは実行しない。
lipluscodex
commented
Sep 10, 2026
lipluscodex
left a comment
lipluscodex
left a comment
Member
Author
There was a problem hiding this comment.
Self-review
- Mode:
auto - Issue alignment: PASS — v4のterminal failureを再試行せず、ambient
PYTHONPATHへ依存しない自己完結v5 runnerをresult-freeで凍結している。 - Import-safe boundary: PASS —
python -I tools/run_github_retrieval_parity_v5.py --import-smokeがrepo rootで成功し、GitHub RAG request / NGR search / SQLite open / artifact createはいずれも0。effect surfaceをblockするtestも含む。 - Protocol inheritance: PASS — v4 corpus 93文書とpath prefixを複製せず参照し、固定10 query / gold / gate / request / metric semanticsをv4と比較して機械検証している。
- Evidence boundary: PASS — v5 development / holdoutのpreflight / capture / claim / resultは全不在。v4 terminal evidenceとv1-v4 predecessor registryをhash監査し、既存証拠の変更なし。
- Scope: PASS — production default、MCP登録、SQLite schema、feedback contract、Li+、github-rag-mcp production設定、shared SQLite、新規repositoryに変更なし。
- Verification: PASS — parent再実行target 11/11、local normal 419/419、historical分離396/396、Linux CI full discovery 815/815、Optional MCP 33/33、変更Python Ruff、JSON、UTF-8、diff checkが成功。
Findings
- now: なし
- later: Windows単一process
allは約405件でnative access violation。Python test failure/errorは0で、Windows process分離815/815とLinux単一process815/815が成功しているため、本PRのblocking findingにはしない。 - accepted: なし
Verdict: PASS
lipluscodex
deleted the
226-freeze-import-safe-retrieval-parity-v5-protocol
branch
September 10, 2026 09:41
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes #226
ambient
PYTHONPATHなしで起動する自己完結v5 runnerとclean-env zero-effect smokeをresult-freeで凍結する。v4の93文書、固定query / gold / gateの意味、v1-v4証跡bytesを維持し、v5 registryと観測を分離する。
local normal 419/419とprocess分離historical 396/396はpassしたが、Windowsの単一process
allはnative access violationとなったためLinux CIでも全discoverを確認する。