"...are Rushing Nowhere (and How to Fix It)" — IEEE SaTML 2025 Best Paper (AISP + Marek Rei): shows post-hoc membership-inference and contamination evaluations are confounded by distribution shift, and proposes randomized-test protocols. Core evaluation science for anyone auditing training-data contamination; dated by the award venue.

Paper

evalsafetyresearch

Related