Publications — Junjie Ye

Z-sight: Unifying Vision-Language-Action and Latent World Modeling

Junjie Ye*, Yiqi Zhao*, Muchen Xu*, Celina Shiyu Wang, Hao Dong, Ruohai Ge, Rong Xue, Benjamin J Kolligs, Aditya Dutt, Nassim A. Samad, Jyotirmoy V. Deshmukh, Yue Wang†, Yuliang Guo†

In Submission

Regularizing Layer Fusion Mitigates the Reconstruction–Generation Gap in Representation Autoencoders

Hongyang Du, Yunfei Xie, Junjie Ye, Jiawei Yang, Xiaoyan Cong, Haodong Zhang, Yongchao Huang, Haiyu Wu, Zongxia Li, Shihang Gui, Dawei Liu, Runhao Li, Jingcheng Ni, Chen Wei†, Randall Balestriero†, Yue Wang†

arXiv 2026 PDF Code Project

Rolling-WAM: World Action Models with Rolling Imagination

Yinghua Zhou*, Junjie Ye*, Yiqi Zhao, Hao Dong, Celina Shiyu Wang, Ruohai Ge, Tingyi Yang, Basile Van Hoorick, Gaurav S. Sukhatme, Vitor Guizilini†, Yue Wang†

arXiv 2026 PDF Code Project

PhysWAM: Physically Consistent World Action Model for Autonomous Driving

Dhruv Parikh, Fengcheng Yu, Quankai Gao, Jiawei Yang, Junjie Ye, Maulik Bhatt, Thang Vu, Charles Ochoa, Rowan McAllister, Igor Vasiljevic, Rajgopal Kannan, Viktor Prasanna, Vitor Guizilini, Yue Wang

arXiv 2026 PDF

DriveReferee: Geometric Safety Verdicts Need Not Be Learned for Driving World-Action Models

Fengcheng Yu, Dhruv Parikh, Junjie Ye, Maulik Bhatt, Thang Vu, Igor Vasiljevic, Vitor Guizilini, Yue Wang

arXiv 2026 PDF

Logic-VLA: A Temporal Logic Conditioned Vision-Language-Action Model

Celina Shiyu Wang, Yiqi Zhao, Junjie Ye, Yue Wang, Jyotirmoy V. Deshmukh

arXiv 2026 PDF

Learning Event Perturbation Field for Continuous Event Stream-Based Object Tracking

Fuling Lin, Junjie Ye, Zhiqiang Chen, Changhong Fu, Peng Lu

IEEE RA-L 2026 PDF

DUET: Dual-Robot Understanding via Efficient Teaching

🏆 Best Contribution Award, IROS 2026 Real-World Multi-Robot Cooperation Workshop
🏆 Best Paper Finalist, IROS 2026 PhysCollabBot Workshop

Yiqi Zhao*, Ruohai Ge*, Celina Shiyu Wang, Junjie Ye, Muchen Xu, Minhao Li, Sergey Zakharov, Basile Van Hoorick, Vitor Campagnolo Guizilini, Leonidas Guibas, Gaurav S. Sukhatme, Jyotirmoy V. Deshmukh, Yue Wang

arXiv 2026 PDF Project

RoboDream: Compositional World Models for Scalable Robot Data Synthesis

Junjie Ye, Rong Xue, Basile Van Hoorick, Runhao Li, Harshitha Belagavi Rajaprakash, Pavel Tokmakov, Muhammad Zubair Irshad, Vitor Guizilini†, Yue Wang†

IROS 2026 PDF Project

SIMPLE: Simulation-Based Policy Learning and Evaluation for Humanoid Loco-manipulation

Songlin Wei*, Zhenhao Ni*, Jie Liu*, Zhenyu Zhao*, Junjie Ye, Hongyi Jing, Junkai Xia, Xiawei Liu, Michael Leong, Liang Heng, Di Huang, Yue Wang

CoRL 2026 PDF Project

VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generation

🏆 Third Place Award, CVPR 2026 Image-to-Video Consistent Generation Challenge

Hongyang Du*, Junjie Ye*, Xiaoyan Cong*, Runhao Li, Jingcheng Ni, Aman Agarwal, Zeqi Zhou, Zekun Li, Randall Balestriero, Yue Wang

ICML 2026 PDF Code Project

AnchorDream: Repurposing Video Diffusion for Embodiment-Aware Robot Data Synthesis

Junjie Ye, Rong Xue, Basile Van Hoorick, Pavel Tokmakov, Muhammad Zubair Irshad, Yue Wang, Vitor Guizilini

ICRA 2026 PDF Code Project

SMART: Advancing Scalable Map Priors for Driving Topology Reasoning

Junjie Ye, David Paz, Hengyuan Zhang, Yuliang Guo, Xinyu Huang, Henrik I. Christensen, Yue Wang, Liu Ren

ICRA 2025 PDF Project

RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulation

Yuxuan Kuang*, Junjie Ye*, Haoran Geng*, Jiageng Mao, Congyue Deng, Leonidas Guibas, He Wang, Yue Wang

CoRL 2024Oral PDF Code Project

Agent-Driver: A Language Agent for Autonomous Driving

Jiageng Mao*, Junjie Ye*, Yuxi Qian, Marco Pavone, Yue Wang

COLM 2024 PDF Code Project

Universal Humanoid Robot Pose Learning from Internet Human Videos

Jiageng Mao, Siheng Zhao, Siyu Song, Chengdong Hong, Tianshi Shi, Junjie Ye, Mingtong Zhang, Haoran Geng, Jitendra Malik, Yue Wang

Humanoids 2024 PDF

GPT-Driver: Learning to Drive with GPT

Jiageng Mao, Yuxi Qian, Junjie Ye, Hang Zhao, Yue Wang

NeurIPS 2023 Workshop PDF Code Project

PVT++: A Simple End-to-End Latency-Aware Visual Tracking Framework

Bowen Li, Ziyuan Huang, Junjie Ye, Yiming Li, Sebastian Scherer, Hang Zhao, Changhong Fu

ICCV 2023 PDF Project

SGDViT: Saliency-Guided Dynamic Vision Transformer for UAV Tracking

Liangliang Yao, Changhong Fu, Sihang Li, Guangze Zheng, Junjie Ye

ICRA 2023 Code

Scale-Aware Domain Adaptation for Robust UAV Tracking

Changhong Fu, Teng Li, Junjie Ye, Guangze Zheng, Sihang Li, Peng Lu

IEEE RA-L 2023 PDF Code Video

Siamese Object Tracking for Unmanned Aerial Vehicle: A Review and Comprehensive Analysis

Changhong Fu, Kunhan Lu, Guangze Zheng, Junjie Ye, Ziang Cao, Bowen Li, Geng Lu

Artificial Intelligence Review 2023 PDF Code

An Open-Source Robotic Chinese Chess Player

Shan An, Guangfu Che, Jinghao Guo, Yanjie Xu, Guoxin Wang, Konstantinos A. Tsintotas, Fukai Zhang, Junjie Ye, Changhong Fu, Haogang Zhu, Hong Zhang

IROS 2023 PDF

Unsupervised Domain Adaptation for Nighttime Aerial Tracking

Junjie Ye, Changhong Fu, Guangze Zheng, Danda Pani Paudel, Guang Chen

CVPR 2022 PDF Code Dataset

Tracker Meets Night: A Transformer Enhancer for UAV Tracking

Junjie Ye, Changhong Fu, Ziang Cao, Shan An, Guangze Zheng, Bowen Li

IEEE RA-L 2022 PDF Code Dataset Video

Ad2Attack: Adaptive Adversarial Attack on Real-Time UAV Tracking

Changhong Fu, Sihang Li, Xinnan Yuan, Junjie Ye, Ziang Cao, Fangqiang Ding

ICRA 2022 PDF Code

End-to-End Feature Decontaminated Network for UAV Tracking

Haobo Zuo, Changhong Fu, Sihang Li, Junjie Ye, Guangze Zheng