I am a Master’s student from Tongji University. I am working in the TOPS Lab, and supervised by Professor Jian Sun and Peng Hang. Simultaneously, I am interning at UC Berkeley as a visiting scholar, where I am collaborating with Prof. Masayoshi Tomizuka, Dr. Mingyu Ding, and Dr. Zhan Wei.

My research interests include autonomous vehicles, decision-making, social interaction, reinforcement learning , game theory, and foundation models. And my research vision is to build a safer, more generalized, and socially compatible autonomous system.

I am currently seeking a Ph.D. position in a relevant field and anticipate starting my studies in the fall of 2025.

🔥 News

2024.09: One paper entitled Towards Interactive and Learnable Cooperative Driving Automation: a Large Language Model-Driven Decision-making Framework is pre-printed.
2024.08: 🎉🎉 One paper (Co-first author) is accepted by ECCV 2024 MAAS Workshop(Oral)
2024.08: Two papers are preprinted on Arxiv: (1) MAPPO-PIS: A Multi-Agent Proximal Policy Optimization Method with Prior Intent Sharing for CAVs’ Cooperative Decision-Making, (2) Towards Safe and Robust Autonomous Vehicle Platooning: A Self-Organizing Cooperative Control Framework
2024.08: 🎉🎉 I won the IEEE ITSC 2024 Travel Award.
2024.07: 🎉🎉 One paper (first author) is accepted by ITSC 2024.
2024.06: 🎉🎉 One paper (first author) is accepted by Transportmetrica B: Transport Dynamics.
2024.06: One paper entitled A Decision-Making GPT Model Augmented with Entropy Regularization for Autonomous Vehicles is pre-printed on ArXiv. Find paper here.
2024.04: One paper entitled Delay-Aware Multi-Agent Reinforcement Learning for Cooperative Adaptive Cruise Control with Model-based Stability Enhancement is pre-printed on ArXiv. Find paper here.
2024.04: 🎉🎉 One paper (first author) is accepted by IEEE Transactions on Vehicular Technology(SCI, Q1).
2024.01: One paper entitled DDM-Lag : A Diffusion-based Decision-making Model for Autonomous Vehicles with Lagrangian Safety Enhancement is pre-printed on ArXiv. Find paper here.
2023.12: One paper entitled Enhancing Social Decision-Making of Autonomous Vehicles: A Mixed-Strategy Game Approach With Interaction Orientation Identification is pre-printed on ArXiv. Find paper here.
2023.11: 🎉🎉 One paper (first author) is accepted by IEEE Transactions on Intelligent Vehicles(SCI, Q1).
2023.10: 🎉 One paper (first author) is accepted by Transportation Research Board 103th Annual MeetingTransportation Research Board.
2023.09: One paper entitled Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awareness is pre-printed on ArXiv. Find paper here.
2023.08: One paper entitled Teaching Autonomous Vehicles to Express Interaction Intent during Unprotected Left Turns: A Human-Driving-Prior-Based Trajectory Planning Approach is pre-printed on ArXiv. Find paper here.
2023.07: 🎉🎉 As the first author or the corresponding author, I got three papers accepted by the 26th IEEE International Conference on Intelligent Transportation Systems (ITSC 2023)!
2023.05: One paper entitled Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priors is pre-printed on techrxiv. Find paper here.
2022.09: 🎉🎉 I was bestowed with the Nominee Award for Shanghai University Student Annual Character, a recognition of paramount importance in evaluating the comprehensive aptitudes and societal influence of college students within the Shanghai municipality. Only 20 people in Shanghai receive the award each year (including nominees)!
2022.06: 🎉🎉 I received my Bachelor degree from Tongji University with the first overall ranking in my major (1/163), and I got the honor of Shanghai Outstanding Graduate(Top 1%)!
2021.05: 🎉🎉 I received the Tongji University Pursuit of Excellence Award, the highest honor for undergraduates at Tongji University! Only three undergraduates are able to receive this honor each year!
2020.11: 🎉🎉 I won the only Grand Prize in the China Reverse Logistics Design Competition
2020.10: 🎉🎉 I won the Best Paper Award in CUMCM! CUMCM is the largest basic academic competition for undergraduate students in China, and 3 papers were awarded from 42,000+ candidates!
2020.10: 🎉🎉 I won the first prize of China Transportation Science and Technology Competition, which is the most important undergraduate academic competition in China’s transportation field!
🎉🎉🎉: My story and work during my undergraduate studies were reported by several influential Chinese media outlets. You can find more content here: 1, 2, 3

📝 Publications

DDM-Lag : A Diffusion-based Decision-making Model for Autonomous Vehicles with Lagrangian Safety Enhancement

Jiaqi Liu, Peng Hang, Xiaocong Zhao, Jianqiang Wang, Jian Sun, preprint.

Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awareness

Jiaqi Liu, Donghao Zhou, Peng Hang, Ying Ni, Jian Sun, IEEE Transactions on Intelligent Vehicles(TIV), DOI: 10.1109/TIV.2023.3332080, 2023.

MAPPO-PIS: A Multi-Agent Proximal Policy Optimization Method with Prior Intent Sharing for CAVs’ Cooperative Decision-Making

Yicheng Guo$^\star$, Jiaqi Liu$^\star$, Rongjie Yu, Peng Hang, Jian Sun, accepted by ECCV 2024 MAAS Workshop(Oral).

MTD-GPT: A Multi-Task Decision-Making GPT Model for Autonomous Driving at Unsignalized Intersections

Jiaqi Liu, Peng Hang, Xiao Qi, Jianqiang Wang, Jian Sun, IEEE 26th International Conference on Intelligent Transportation Systems (ITSC), Bilbao, Spain, 2023.

Enhancing Social Decision-Making of Autonomous Vehicles: A Mixed-Strategy Game Approach With Interaction Orientation Identification

Jiaqi Liu, Xiao Qi, Peng Hang, Jian Sun, IEEE Transactions on Vehicular Technology(TVT), DOI:10.1109/TVT.2024.3385750.

Delay-Aware Multi-Agent Reinforcement Learning for Cooperative Adaptive Cruise Control with Model-based Stability Enhancement

Jiaqi Liu, Ziran Wang, Peng Hang, and Jian Sun, accepted by ITSC 2024.

A Decision-Making GPT Model Augmented with Entropy Regularization for Autonomous Vehicles

Jiaqi Liu, Shiyu Fang, Xuekai Liu, Lulu Guo, Peng Hang, Jian Sun, accepted by 8th CAA International Conference on Vehicular Control and Intelligence (CVCI 2024)

Teaching Autonomous Vehicles to Express Interaction Intent during Unprotected Left Turns: A Human-Driving-Prior-Based Trajectory Planning Approach

Jiaqi Liu, Xiao Qi, Ying Ni, Jian Sun, Peng Hang, preprint.

Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priors

Jiaqi Liu, Peng Hang, Xiaoxiang Na, Chao Huang, Jian Sun, preprint.

Towards Interactive and Learnable Cooperative Driving Automation: a Large Language Model-Driven Decision-making Framework, Shiyu Fang, Jiaqi Liu, Mingyu Ding, Chen Lv, Peng Hang, Jian Sun, preprint.
Evaluation of Drivers’ Interaction Ability at Social Scenarios: A Process-Based Framework, Jiaqi Liu, Peng Hang, Xiangwang Hu, Jian Sun, Transportmetrica B: Transport Dynamics, DOI: 10.1080/21680566.2024.2380913.
Towards Safe and Robust Autonomous Vehicle Platooning: A Self-Organizing Cooperative Control Framework, Chengkai Xu, Zihao Deng, Jiaqi Liu$^\star$, Chao Huang, Peng Hang$^\star$, preprint.
Design of the Reverse Logistics System for Medical Waste Recycling Part I: System Architecture, Classification & Monitoring Scheme, and Site Selection Algorithm, Chaozhong Xue, Yongqi Dong, Jiaqi Liu$^\star$, Yijun Liao, Lingbo, IEEE 26th International Conference on Intelligent Transportation Systems (ITSC), Bilbao, Spain, 2023.
Design of the Reverse Logistics System for Medical Waste Recycling Part II: Route Optimization with Case Study under COVID-19 Pandemic, Chaozhong Xue, Yongqi Dong, Jiaqi Liu$^\star$, Yijun Liao, Lingbo, IEEE 26th International Conference on Intelligent Transportation Systems (ITSC), Bilbao, Spain, 2023.
Optimal Placement of Charging Stations in Road Networks: A Reinforcement Learning Approach with Attention Mechanism, Jiaqi Liu, Jian Sun, and Xiao Qi, Applied Sciences 13.14 (2023): 8473.
Surrogate Evaluation Model for Assessing Lane Detection Reliability of Automated Vehicles in Complex Road Environments, Chen Chai, Tao Liu, Jiaqi Liu, Xu Cao, Yuchen Hu, Qingtao Li, Transportation Research Record.

🎖 Honors and Awards

2024.08 IEEE ITSC 2024 Travel Award
2023.12 Jingchuan Scholarship
2023.01 Dean’s Scholarship, College of Transportation Engineering, Tongji University (Only one)
2022.10 Shanghai University Student Annual Character (Nomination Award)!
2022.06 Outstanding Graduates from Shanghai(Top 1%).
2021.12 National Scholarship, Ministry of Education of China
2021.05 Tongji University Pursuit of Excellence Award (3/4450) !
2020.11 The only Grand Prize in China Reverse Logistics Design Competition (1 / 329)
2020.10 Best paper award of Contemporary Undergraduate Mathematical Contest in Modeling (CUMCM) (3/ 42000+) !
2020.10 First Prize in China Transportation Science and Technology Competition
2020.10 First Prize in the Shanghai College Students Transportation Innovation Competition
2020.6 First Prize in the 19th Transportation Science and Technology Competition at Tongji University
2020.5 First Prize in Tongji University Mathematical Modeling Contest
2019.12 National Scholarship, Ministry of Education of China
2019-2022 Outstanding Student Award at Tongji University
2019-2022 Tang Zhongying Moral Education Scholarship
2019-2022 Undergraduate Social Activity Scholarship at Tongji University

📖 Educations

2022.09 - now, Master of Traffic Engineering, Tongji University, Shanghai, China
2018.09 - 2022.06, Bachelor of Traffic Engineering, Tongji University, Shanghai, China (GPA: 4.91/5, rank: 1/163)

📚 Academic Services

Reviews

Journal Reviewer: IEEE Transactions on Intelligent Vehicles (TIV), IEEE Transactions on Intelligent Transportation Systems (TITS), Journal of Field Robotics, IEEE Transactions on Industrial Informatics (TII), IEEE Transactions on Vehicular Technology (TVT), IEEE Transactions on Automation Science and Engineering (TASE), Journal of Advanced Transportation
Conference Reviewer: ITSC, CVCI, TRB

Jiaqi Liu

🔥 News

📝 Publications

🎖 Honors and Awards

📖 Educations

📚 Academic Services

Reviews

Mentoring

Ph.D. students

Undergraduate students