Skip to content

Report actionable collator column errors - #5

Merged
capemox merged 2 commits into
mainfrom
fix/collator-column-errors
Aug 16, 2026
Merged

Report actionable collator column errors#5
capemox merged 2 commits into
mainfrom
fix/collator-column-errors

Conversation

@capemox

@capemox capemox commented Aug 16, 2026

Copy link
Copy Markdown
Owner

Summary

  • validate configured dataset columns before tokenization
  • replace raw KeyError failures with collator-specific ValueError messages
  • identify the corresponding configuration argument and available columns
  • reject empty batches consistently
  • cover RetroMAE, MNRL, contrastive, and supervised SimCSE failure cases

Validation

  • reproduced the reported raw KeyError cases before the fix
  • uv run ruff check .
  • uv run mypy --python-version 3.10 src/pretense
  • uv run pytest -q (111 passed)

@capemox
capemox merged commit a364dce into main Aug 16, 2026
4 checks passed
@capemox
capemox deleted the fix/collator-column-errors branch August 16, 2026 19:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant