Audit toolkit for surface shortcuts, structural leakage, and duplicates in preference-pair datasets.
model-evaluation data-curation dpo human-feedback-data data-auditing human-feedback rlhf llm-evaluation preference-data model-evaluation-and-validation dataset-quality preference-dataset
-
Updated
Aug 24, 2026 - Python