Robust and Safe Reinforcement Learning

Breaking the Curse of Multiagency in Robust Multi-Agent Reinforcement Learning

Laixi Shi*, Jingchu Gai*, Eric Mazumdar, Yuejie Chi, Adam Wierman.
In submission

[Arxiv]

Robust Gymnasium: A Unified Modular Benchmark for Robust Reinforcement Learning

Shangding Gu*, Laixi Shi*, Muning Wen, Ming Jin, Eric Mazumdar, Yuejie Chi, Adam Wierman, Costas Spanos
In submission

[Github]

Sample-Efficient Robust Multi-Agent Reinforcement Learning in the Face of Environmental Uncertainty

Laixi Shi, Eric Mazumdar, Yuejie Chi, Adam Wierman.
International Conference on Machine Learning (ICML), 2024.

[Arxiv]

Tractable Equilibrium Computation in Markov Games through Risk Aversion

Eric Mazumdar*, Kishan Panaganti*, Laixi Shi*.
Preprint.

[Arxiv]

Sample complexity of offline distributionally robust linear markov decision processes

He Wang, Laixi Shi, Yuejie Chi.
Reinforcement Learning Conference (RLC), 2024.

[Arxiv]

The Curious Price of Distributional Robustness in Reinforcement Learning with a Generative Model

Laixi Shi, Gen Li, Yuting Wei, Yuxin Chen, Matthieu Geist, Yuejie Chi.
Under review at Operations Research
Conference on Neural Information Processing Systems (NeurIPS), 2023.

[Paper] [Slides]

Distributionally Robust Model-Based Offline Reinforcement Learning with Near-Optimal Sample Complexity

Laixi Shi and Yuejie Chi.
Journal of Machine Learning Research (JMLR), 2024.

[Paper] [Slides]

Enhancing Efficiency of Safe Reinforcement Learning via Sample Manipulation

Shangding Gu*, Laixi Shi*, Yuhao Ding, Alois Knoll, Costas Spanos, Adam Wierman, Ming Jin.
Conference on Neural Information Processing Systems (NeurIPS), 2024.

[Arxiv]

Seeing is not Believing: Robust Reinforcement Learning against Spurious Correlation

Wenhao Ding*, Laixi Shi*, Yuejie Chi, Ding Zhao.
Conference on Neural Information Processing Systems (NeurIPS), 2023.
The Second Workshop on Spurious Correlations, Invariance and Stability of ICML, 2023.

[Arxiv] [Website]

Data-Efficient Reinforcement Learning

Federated Offline Reinforcement Learning: Collaborative Single-Policy Coverage Suffices

Jiin Woo, Laixi Shi, Gauri Joshi, Yuejie Chi.
International Conference on Machine Learning (ICML), 2024.

[Arxiv]

Settling the Sample Complexity of Model-Based Offline Reinforcement Learning

Gen Li, Laixi Shi, Yuxin Chen, Yuejie Chi, Yuting Wei.
The Annals of Statistics, 2024.

[Paper]

Pessimistic Q-Learning for Offline Reinforcement Learning: Towards Optimal Sample Complexity

Laixi Shi, Gen Li, Yuting Wei, Yuxin Chen, Yuejie Chi.
International Conference on Machine Learning (ICML), 2022.

[Paper]

Breaking the Sample Complexity Barrier to Regret-Optimal Model-Free Reinforcement Learning

Gen Li, Laixi Shi, Yuxin Chen, Yuejie Chi
Information and Inference: A Journal of the IMA, 2023.
NeurIPS Spotlight, 2021

[Paper] [Arxiv] [Talk] [Slides] [Poster]

Offline Reinforcement Learning with On-Policy Q-Function Regularization

Laixi Shi, Robert Dadashi, Yuejie Chi, Pablo Samuel Castro, Matthieu Geist.
European Conference on Machine Learning (ECML), 2023.

[Arxiv]

A Trajectory is Worth Three Sentences: Multimodal Transformer for Offline Reinforcement Learning

Yiqi Wang, Mengdi Xu, Laixi Shi, Yuejie Chi.
The Conference on Uncertainty in Artificial Intelligence (UAI), 2023.

[Paper]

Curriculum Reinforcement Learning using Optimal Transport via Gradual Domain Adaptation

Peide Huang, Mengdi Xu, Jiacheng Zhu, Laixi Shi, Fei Fang, Ding Zhao
Conference on Neural Information Processing Systems (NeurIPS), 2022.

[Paper]

Data-Driven Optimization for Inverse Problems

Manifold Gradient Descent Solves Multi-channel Sparse Blind Deconvolution Provably and Efficiently

Laixi Shi, Yuejie Chi
IEEE Transactions on Information Theory, 2021.
International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2020.

[Paper] [Slides] [Poster]

Robust camera pose estimation for image stitching

Laixi Shi, Dehong Liu, Jay Thornton
IEEE International Conference on Image Processing (ICIP), 2021.

[Paper] [Slides]

Fusion-Based Digital Image Correlation Framework for Strain Measurement

Laixi Shi, Dehong Liu, Masaki Umeda, and Norihiko Hana
International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2021.

[Paper] [Slides]

Device-free Multiple People Localization through Floor Vibration

Laixi Shi, Mostafa Mirshekari, Jonathon Fagert, Yuejie Chi, Hae Young Noh, Pei Zhang, and Shijia Pan
The First ACM Workshop on Device-Free Human Sensing, 2019.

[Paper] [Slides]

Micro Hand Gesture Recognition System Using Ultrasonic Active Sensing

Yu Sang, Laixi Shi, Yimin Liu
IEEE Access, 2018.

[Paper] [Video]