Skip to content

Publish measured token-efficiency evidence - #12

Merged
robertkeus merged 2 commits into
mainfrom
develop
Aug 12, 2026
Merged

Publish measured token-efficiency evidence#12
robertkeus merged 2 commits into
mainfrom
develop

Conversation

@robertkeus

Copy link
Copy Markdown
Owner

Summary

Promote the pinned Honey and ESON benchmark evidence from develop to main.

Evidence

  • ESON: 3,151 vs 4,395 o200k tokens on five losslessly round-tripped handoff documents (-28%)
  • Honey / Opus 4.8: output -29% (p=.020), LOC -43% (p<.001)
  • Honey / GPT-5.5: output -20% (p=.004), LOC -18% (p<.001)
  • total Honey cost: not significant on either provider
  • Peter: explicitly no end-to-end cost-savings claim without a control run

Validation

@robertkeus
robertkeus merged commit 67a76cc into main Aug 12, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant