CV

Education

• Ludwig Maximilian University of Munich, Germany
  • PhD in Deep Reinforcement Learning, Computer Science, 12, 2016–09, 2020
• Technical University of Munich, Germany
  • MSc in Robotics, Cognition, Intelligence, Computer Science, 10, 2014–10, 2016
• Munich University of Applied Sciences, Germany
  • BSc in Mechatronics, (double-degree program), 10, 2013–10, 2014
• Tongji University, China
  • BSc in Mechatronics, (double-degree program), 09, 2010–09, 2013

Work experience

• Tencent, Shenzhen, Guangdong, China
  Tencent AI Lab
  • research scientist, 12. 2020–present
    • deep reinforcement learning in game AI
• Horizon Robotics Inc., Cupertino, CA, United States
  General Artificial Intelligence Lab
  • researcher, 06. 2019–11. 2019
    • deep reinforcement learning in robotics
• Siemens Corporate Technology, Munich, BY, Germany
  Research Group Machine Intelligence
  • researcher, 12. 2016–11. 2020
    • machine learning, especially deep reinforcement learning in robotics and dialog agents
• German Aerospace Center (DLR), Weßling, BY, Germany
  Institute of Robotics and Mechatronics
  • researcher, 04. 2016–10. 2016
    • persons activity recognition in RGBD using deep learning

Publications

Two-Stream RNN/CNN for Action Recognition in 3D Videos

Learning Goal-Oriented Visual Dialog via Tempered Policy Gradient

Efficient Dialog Policy Learning via Positive Memory Retention

Energy-Based Hindsight Experience Prioritization

Curiosity-Driven Experience Prioritization via Density Estimation

Maximum Entropy-Regularized Multi-Goal Reinforcement Learning

Mutual Information State Intrinsic Control

Talks

Energy-Based Hindsight Experience Prioritization

October 31, 2018

Oral presentation at Conference on Robot Learning (CoRL 2018), ETH Zürich, Switzerland

Maximum Entropy-Regularized Multi-Goal Reinforcement Learning

June 12, 2019

Spotlight Talk at International Conference on Machine Learning (ICML 2019), Long Beach, California, USA

Mutual Information State Intrinsic Control

May 04, 2021

Spotlight Talk at International Conference on Learning Representations (ICLR 2021), Virtual Only

Service

• Reviewer of International Conference on Machine Learning (ICML), 2021
• Reviewer of IEEE Robotics and Automation Letters (RA-L), 2021
• Reviewer of Conference on Neural Information Processing Systems (NeurIPS), 2020
• Reviewer of International Conference on Machine Learning (ICML), 2020
• Reviewer of IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2020
• Reviewer of IEEE Robotics and Automation Letters (RA-L), 2020
• Reviewer of Journal of Machine Learning Research (JMLR), 2019
• Reviewer of IEEE Robotics and Automation Letters (RA-L), 2018
• Reviewer of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018
• Reviewer of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017