Chenfeng (Jesse) Gao

I am a PhD student in Technology and Social Behavior at Northwestern University, advised by Prof. Karan Ahuja in the SPICE Lab. Previously, I earned an M.S. in Computer Science at the University of Chicago working with Prof. Ken Nakagaki (AxLab), an M.Des. in Human-Computer Interaction from the IIT Institute of Design, and a B.S. in Mathematics from Renmin University of China.

My research follows two threads. The first builds real-time machine learning systems for camera-lite AR, guided by the idea of minimum sufficient sensing: recovering body pose, motion, and spatial context on-device from the always-on, power-efficient IMUs already embedded in consumer devices (e.g., watch, glasses, phone). The second explores LLM-enabled novel interactions — designing applications and end-to-end pipelines that bring generative models into tangible, spatial, and fabrication workflows.

My path to research started in design. After training as a designer and building shape-changing tangible interfaces at AxLab, I now work in the opposite direction — making physical movement digital. That earlier side of my work lives in my design portfolio.

Selected Publications


FlowAvatar: Real-Time Full-Body Avatars from Sparse Egocentric Inputs on Consumer XR Devices teaser

FlowAvatar: Real-Time Full-Body Avatars from Sparse Egocentric Inputs on Consumer XR Devices

Chenfeng Gao, Taeyoung Yeon, Sungheon Park, Vasco Xu, Anish Prabhu, Mar Gonzalez-Franco, Karan Ahuja
ISMAR '26 · Coming Soon
FabDreamer: Exploring the Image-to-Physical Workflow Through AI-Assisted Layered Fabrication teaser

FabDreamer: Exploring the Image-to-Physical Workflow Through AI-Assisted Layered Fabrication

Chenfeng Gao, Zeya Chen, Anjie Yang, Karan Ahuja, Danli Luo
UIST '26 · Coming Soon
ArmPoser: Real-Time, Calibration-Free Arm Pose Estimation from Smartwatch IMU teaser

ArmPoser: Real-Time, Calibration-Free Arm Pose Estimation from Smartwatch IMU

Bishnu Dev, Vasco Xu, Xi-Aan Loh, Chenfeng Gao, Henry Hoffmann, Karan Ahuja
SUI '26 · Coming Soon
MARIO: Motion-Augmented Real-Time Multi-Sensor Inertial Odometry teaser

MARIO: Motion-Augmented Real-Time Multi-Sensor Inertial Odometry

Yiquan Li, Taeyoung Yeon, Chenfeng Gao, Vasco Xu, Xuanyou Liu, Karan Ahuja
CVPR '26 Findings

Shape-Kit: A Design Toolkit for Crafting On-Body Expressive Haptics

Ran Zhou, Jianru Ding, Chenfeng (Jesse) Gao, Wanli (Michael) Qian, Benjamin Erickson, Madeline Balaam, Daniel Leithinger, Ken Nakagaki
CHI '25 · Honorable Mention

MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devices

Vasco Xu, Chenfeng (Jesse) Gao, Henry Hoffmann, Karan Ahuja
UIST '24

SHAPE-IT: Exploring Text-to-Shape-Display for Generative Shape-Changing Behaviors with LLMs

Chenfeng (Jesse) Gao*, Wanli (Michael) Qian*, Anup Sathya, Ryo Suzuki, Ken Nakagaki
UIST '24

AeroRigUI: Actuated TUIs for Spatial Interaction using Rigging Swarm Robots on Ceilings in Everyday Space

Chenfeng (Jesse) Gao*, Lilith Yu*, David Wu, Ken Nakagaki
CHI '23

Towards Multimodal Interaction with AI-Infused Shape-Changing Interfaces

Chenfeng (Jesse) Gao*, Wanli (Michael) Qian*, Richard Liu, Rana Hanocka, Ken Nakagaki
UIST '24 Poster

ShadowAstro: Levitating Constellation Silhouette for Spatial Exploration and Learning

Chenfeng (Jesse) Gao*, Jiatong Li*, Ken Nakagaki
UIST '22 SIC · Jury Honorable Mention