logo
today local_bar
offline alignment

1 paper across 1 session

Poster Session 5

1 paper
Friday, December 5, 2025 · 11:00 AM → 2:00 PM
Exhibit Hall C,D,E
Quantile Reward Policy Optimization: Alignment with Pointwise Regression and Exact Partition Functions
#512 · Simon Matrenok, Skander Moalla, Caglar Gulcehre

QRPO is a SoTA alignment algorithm that can fit the KL-regularized RL objective without relying on preferences.