Publications

NeurIPS · 2026

When Do Learned State Representations Break Sensitivity Analysis?

Accepted · Main Track

ICML · 2026 · Main Track

Reward-Preserving Counterfactual State Editing for Offline Reinforcement Learning

Siyu Wang, Xiaocong Chen, Mingming Gong, Yong Li, Quan Z. Sheng, Lina Yao

ICML · 2026 · Main Track

Continuity-Regularized Flow Matching for Offline Reinforcement Learning

Xiaocong Chen, Siyu Wang, Lina Yao

SIGIR · 2026 · Full Paper

Advantage-Conditioned Flow Policy for Offline Reinforcement Learning in Recommendation

Xiaocong Chen, Siyu Wang, Lina Yao

The Web Conference · 2025 · Main Track · Full Paper

Policy-Guided Causal State Representation for Offline Reinforcement Learning Recommendation

Siyu Wang, Xiaocong Chen, Lina Yao

CIKM · 2025

Maximum In-Support Return Modeling for Dynamic Recommendation with Language Model Prior

Xiaocong Chen, Siyu Wang, Lina Yao

CIKM · 2025

Energy-Guided Diffusion Sampling for Long-Term User Behavior Prediction in Reinforcement Learning-based Recommendation

Xiaocong Chen, Siyu Wang, Lina Yao

IEEE/RSJ IROS · 2025

Diffusion Policies for Risk-Averse Behavior Modeling in Offline Reinforcement Learning

Xiaocong Chen, Siyu Wang, Tong Yu, Lina Yao

ACM Transactions on Intelligent Systems and Technology · 2025

Retentive Decision Transformer with Adaptive Masking for Reinforcement Learning-Based Recommendation Systems

Siyu Wang, Xiaocong Chen, Lina Yao

IEEE Transactions on Neural Networks and Learning Systems · 2025

Plug-and-Play Model-Agnostic Counterfactual Policy Synthesis for Deep Reinforcement Learning-Based Recommendation

Siyu Wang, Xiaocong Chen, Julian McAuley, Sally Cripps, Lina Yao

First published online in 2023

KDD · 2024

Maximum-Entropy Regularized Decision Transformer with Reward Relabelling for Dynamic Recommendation

Xiaocong Chen, Siyu Wang, Lina Yao

CIKM · 2024

On Causally Disentangled State Representation Learning for Reinforcement Learning based Recommender Systems

Siyu Wang, Xiaocong Chen, Lina Yao

ACM Transactions on Information Systems · 2024

On the Opportunities and Challenges of Offline Reinforcement Learning for Recommender Systems

Xiaocong Chen, Siyu Wang, Julian McAuley, Dietmar Jannach, Lina Yao

SIGIR · 2023

Causal Decision Transformer for Recommender Systems via Offline Reinforcement Learning

Siyu Wang, Xiaocong Chen, Dietmar Jannach, Lina Yao

SIGIR · 2023

Causal Disentangled Variational Auto-Encoder for Preference Understanding in Recommendation

Siyu Wang, Xiaocong Chen, Quan Z. Sheng, Yihong Zhang, Lina Yao

World Wide Web · 2023

Intrinsically Motivated Reinforcement Learning based Recommendation with Counterfactual Data Augmentation

Xiaocong Chen, Siyu Wang, Lianyong Qi, Yong Li, Lina Yao

IEEE ICDM · 2022

Empowerment-driven Policy Gradient Learning with Counterfactual Augmentation in Recommender Systems

Xiaocong Chen, Lina Yao, Xiaojun Chang, Siyu Wang