Welcome to AIR-DREAM (Decision-making Research for Empowered AI Methods) Lab Our research focus is to develop advanced learning-based data-driven decision-making theories and practical technologies that are robust, generalizable, and deployable to tackle real-world challenges. We work on fundamental learning algorithms, robust robotic control methods, optimization technologies for real-world AIoT systems, and data-driven decision-making tools & libraries.

AIR-DREAM Lab is a research group at Institute for AI Industry Research (AIR), Tsinghua University.

News

Jan. 2025: Our two recent papers “Robo-MUTUAL: Robotic Multimodal Task Specification via Unimodal Learning” and “H2O+: An Improved Framework for Hybrid Offline-and-Online RL with Dynamics Gaps” have been accepted in ICRA 2025!
Jan. 2025: We have released “Universal Actions for Enhanced Embodied Foundation Models”, which learns universal actions to power any robotic embodiment, physical meaning, and control interfaces! Project page available at https://2toinf.github.io/UniAct/.
Jan. 2025: Our three recent papers “Data Center Cooling System Optimization Using Offline Reinforcement Learning”, “Diffusion-Based Planning for Autonomous Driving with Flexible Guidance”, and “Skill Expansion and Composition in Parameter Space” have been accepted in ICLR 2025!
Dec. 2024: Our recent paper “Are Expressive Models Truly Necessary for Offline RL?” has been accepted as an oral paper in AAAI 2025!
Sep. 2024: Our two recent papers “Instruction-Guided Visual Masking” and “Diffusion-DICE: In-Sample Diffusion Guidance for Offline Reinforcement Learning” have been accepted in NeurIPS 2024!
Jul. 2024: Our two recent papers “DecisionNCE: Embodied Multimodal Representations via Implicit Preference Learning” and “Instruction-Guided Visual Masking” have won the Outstanding Paper Awards at ICML 2024 Workshop on Multi-modal Foundation Model meets Embodied AI (MFM-EAI).
May. 2024: Our four recent papers “DecisionNCE: Embodied Multimodal Representations via Implicit Preference Learning”, “OMPO: A Unified Framework for Reinforcement Learning under Policy and Dynamics Shifts”, “Offline-Boosted Actor-Critic: Adaptively Blending Optimal Historical Behaviors in Deep Off-Policy RL”, “Seizing Serendipity: Exploiting the Value of Past Success in Off-Policy Actor-Critic” have been accepted in ICML 2024!
Apr. 2024: Our recent survey paper “A Comprehensive Survey of Cross-Domain Policy Transfer for Embodied Agents” has been accepted in IJCAI 2024.
Jan. 2024: Our four recent papers “Revealing the Mystery of Distribution Correction Estimation via Orthogonal-gradient Update”, “Safe Offline Reinforcement Learning with Feasibility-Guided Diffusion Model”, “Query-Policy Misalignment in Preference-Based Reinforcement Learning”, and “OpenChat: Advancing Open-source Language Models with Mixed-Quality Data” have been accepted in ICLR 2024!

🔥 We are hiring: we are looking for postdocs and student interns. If you are interested in the research directions of data-driven decision-making, please feel free to contact us!

Researches

Data-Driven Decision-Making Algorithms

Developing high-performance, robust, generalizable, and deployable data-driven decision-making algorithms for real-world problems.

Learning-based Methods for Robotics & Autonomous Driving

Learning robust and generalizable control / decision-making policies for robotics and autonomous driving using real-world data.

Data-Driven Methods for Sustainable Industrial and AIoT Systems

Using advanced data-driven AI methods to optimize real-world complex industrial and AIoT systems.

Tools & Libraries

Tools & software libraries for data-driven decision-making problems.

Recent Publications

Quickly discover relevant content by filtering publications.

Haoyi Niu, Tianying Ji, Bingqi Liu, Haocheng Zhao, Xiangyu Zhu, Jianying Zheng, Pengfei Huang, Guyue Zhou, Jianming HU, Xianyuan Zhan (2025). H2O+: An Improved Framework for Hybrid Offline-and-Online RL with Dynamics Gaps. 2025 IEEE International Conference on Robotics & Automation (ICRA 2025).

PDF Cite Code Project Project Website

Jianxiong Li, Zhihao Wang, Jinliang Zheng, Xiaoai Zhou, Guanming Wang, Guanglu Song, Yu Liu, Jingjing Liu, Ya-Qin Zhang, Junzhi Yu, Xianyuan Zhan (2025). Robo-MUTUAL: Robotic Multimodal Task Specification via Unimodal Learning. 2025 IEEE International Conference on Robotics & Automation (ICRA 2025).

PDF Cite Project Project Website

Xianyuan Zhan, Xiangyu Zhu, Peng Cheng, Xiao Hu, Ziteng He, Hanfei Geng, Jichao Leng, Huiwen Zheng, Chenhui Liu, Tianshun Hong, Yan Liang, Yunxin Liu, Feng Zhao (2025). Data Center Cooling System Optimization Using Offline Reinforcement Learning. The Thirteenth International Conference on Learning Representations (ICLR 2025).

PDF Cite Project Project Website

Yinan Zheng, Ruiming Liang, Kexin Zheng, Jinliang Zheng, Liyuan Mao, Jianxiong Li, Weihao Gu, Rui Ai, Shengbo Eben Li, Xianyuan Zhan, Jingjing Liu (2025). Diffusion-Based Planning for Autonomous Driving with Flexible Guidance. The Thirteenth International Conference on Learning Representations (ICLR 2025).

PDF Cite Code Project Project Website

Tenglong Liu, Jianxiong Li, Yinan Zheng, Haiyi Niu, Yixing Lan, Xin Xu, Xianyuan Zhan (2025). Skill Expansion and Composition in Parameter Space. The Thirteenth International Conference on Learning Representations (ICLR 2025).

PDF Cite Project Project Website

Guan Wang, Haoyi Niu, Jianxiong Li, Li Jiang, Jianming HU, Xianyuan Zhan (2024). Are Expressive Models Truly Necessary for Offline RL?. The 39th Annual AAAI Conference on Artificial Intelligence (AAAI) (oral) (This paper is also accepted in NuerIPS 2024 Workshop on Open-World Agents (OWA)).

PDF Cite Code Project Project

See all publications

Meet the Team

Research team members

Xianyuan Zhan

Faculty Member

Xiangyu Zhu

Research Staff

Jianxiong Li

PhD Student

Jinliang Zheng

PhD Student

Yinan Zheng

PhD Student

Haoyi Niu

Research Intern

Peng Cheng

Research Intern

Tianying Ji

Research Intern

Wenjia Zhang

Research Intern

Xiao Hu

Research Intern

Yu Luo

Research Intern

Ziteng He

Research Intern

Alumni

Haoran Xu

PhD student at UT Austin, USA

Huiling Qin

Faculty at Beijing Normal University, Zhuhai

Li Jiang

PhD student at McGill University

Liyuan Mao

Undergraduate student at Shanghai Jiao Tong University

Weiye Xi

PhD student at Columbia Business School, USA

Xiangsen Wang

AI Algorithm engineer at Baidu

Yiwen Qiu

Master student at Carnegie Mellon University, USA

Yong Wang

PhD student at BIT (Beijing Institute of Technology)

Gallery

Contact

zhanxianyuan@mail.tsinghua.edu.cn
12 / F, block C, Qidi science and technology building, Tsinghua Science and Technology Park, Haidian District, Beijing, 100000
Find us on GitHub