Algorithms

Are Expressive Models Truly Necessary for Offline RL?
Among various branches of offline reinforcement learning (RL) methods, goal-conditioned supervised learning (GCSL) has gained …
PDF Cite Code Project Project
Are Expressive Models Truly Necessary for Offline RL?
Diffusion-DICE: In-Sample Diffusion Guidance for Offline Reinforcement Learning
One important property of DIstribution Correction Estimation (DICE) methods is that the solution is the optimal stationary distribution …
PDF Cite Code Project Website
Diffusion-DICE: In-Sample Diffusion Guidance for Offline Reinforcement Learning
Instruction-Guided Visual Masking
Instruction following is crucial in contemporary LLM. However, when extended to multimodal setting, it often suffers from misalignment …
PDF Cite Code Project Project Website
Instruction-Guided Visual Masking
Bidirectional-Reachable Hierarchical Reinforcement Learning with Mutually Responsive Policies
Hierarchical reinforcement learning (HRL) addresses complex long-horizon tasks by skillfully decomposing them into subgoals. Therefore, …
PDF Cite Project
OMPO: A Unified Framework for RL under Policy and Dynamics Shifts
Training reinforcement learning policies using environment interaction data collected from varying policies or dynamics presents a …
PDF Cite Project
Offline-Boosted Actor-Critic: Adaptively Blending Optimal Historical Behaviors in Deep Off-Policy RL
Off-policy reinforcement learning (RL) has achieved notable success in tackling many complex real-world tasks, by leveraging previously …
PDF Cite Project
DecisionNCE: Embodied Multimodal Representations via Implicit Preference Learning
Multimodal pretraining has emerged as an effective strategy for the trinity of goals of representation learning in autonomous robots: …
PDF Cite Code Project Project Website
Seizing Serendipity: Exploiting the Value of Past Success in Off-Policy Actor-Critic
Learning high-quality Q-value functions plays a key role in the success of many modern off-policy deep reinforcement learning (RL) …
PDF Cite Code Project
A Comprehensive Survey of Cross-Domain Policy Transfer for Embodied Agents
The burgeoning fields of robot learning and embodied AI have triggered an increasing demand for large quantities of data. However, …
PDF Cite Code Project
A Comprehensive Survey of Cross-Domain Policy Transfer for Embodied Agents
Query-Policy Misalignment in Preference-Based Reinforcement Learning
Preference-based reinforcement learning (PbRL) provides a natural way to align RL agents’ behavior with human desired outcomes, but is …
PDF Cite Project