offline-to-online RL

2 papers across 1 session

Poster Session 3

2 papers

Thursday, December 4, 2025 · 11:00 AM → 2:00 PM

Exhibit Hall C,D,E

Uni-RL: Unifying Online and Offline RL via Implicit Value Regularization

#303 · Haoran Xu, Liyuan Mao, Hui Jin, Weinan Zhang, Xianyuan Zhan, Amy Zhang

A unified and scalable RL framework applicable to online, offline, and offline-to-online settings.

Reinforcement Learning with Action Chunking

#415 · Qiyang Li, Zhiyuan (Paul) Zhou, Sergey Levine

We propose Q-chunking, a simple, effective offline-to-online RL method that uses action chunking to improve value propagation and exploration via temporally coherent actions.