Nice to meet you
Just call me Jesse.
I'm a technical User Experience designer based in Chicago, being passionate about XR design and other tangible IXD.
What if there was a system in place to support hybrid living?
HMW connect hybrid workers with the right resources in their neighborhood.
When WebXR becomes common, how should designers get ready for the new design area?
Getting more people involved in Translational Research is the key to save more lives.
In the new norm, HMW bring back daily socialization for remote workers while protecting their boundaries?
In the post-pandemic, are cloud drinking and in-home dancing possible? MR gave the solution.
What if facial expressions are a new input for games? How life looks like in AR.
Summer Intern in iMotions, working on implementing eye-tracking SDK to Varjo XR-3 and making tutorials for clients and sales team.
What's the user experience when Lvl 5 AV comes to campus? An entire system for self-driving shuttle.
Using COVID daily death data , bringing a new Monument to tell one thing — the passing lives are not numbers, we should remember them.
Concept, motion, UX design
Jason Zhang, Jesse Gao, Zeya Chen
A conceptual interaction design for on - campus autonomous shuttle
of Illinois Institute of Technology
Robotics lab at Illinois Institute of Technology has conducted in-depth tests and research on the navigation functions of autonomous vehicles. The research project uses radar sensing technology to scan the surrounding environment in order to generate maps. This emerging technology provides the self-driving car industry with road testing on the main campus of IIT. Since the laboratory obtain the valuable research data of the campus. We decided to design a self-driving school shuttle for the IIT campus, and create an unique experience concept.
Challenge & Outcome
How to design the functions of an autonomous shuttle in a specific campus setting? Especially when the average on-road time is less than 5 minutes, what are the real needs of users? What features can improve user experience? Through the process of user research, ideation, definition and visualization, we proposed a interaction system suitable for autonomous school shuttle on campus.
Part 01 / 3
BOOKING TRIPS & PREFERENCE SETTING
Importing class schedules and add personal routines makes daily commute easily.
Anytime to modify upcoming trips to provide conviencience.
Noitification in many ways to make passengers clear.
Options for personalizing in-car environment let the whole trip chill.
SCHEDULE WITH STUDENT ACCOUNT
Different from normal trip booking APP, we provide routine commute options based on students’ class schdules.
Given the test results and data colected from IIT Robotics Lab, we need to find out the way of how to make those data meaningful and apply them into daily life. So we started from designing the school AV specifically for IIT, because of the existing factors in Chicago -- the high crimal rate around our campus.
We did secondary research and user interviews not only to understand what can AV bring to us, but also to find out the real needs/desires from IIT people.
Combining current market trends with our local user insights, we explored how to build TRUST from outside screen to inside screen interaction between passenger and car, car and car, car and pedestrian. Finally focus on the user journey, experience of taking a AV shuttle on campus.
3. Definition & Visualization
In the final stage, we introduced the mobile application, outside shuttle information panel and inside controller pad, then visualized how user could interact with those screens.
MODIFY COMMUTE IN A FEW STEPS
Finding the pre-set commutes in the clear layout of daily schedule makes the fixed shuttle bus more flexible.
MULTIPLE WAYS TO INFORM UPCOMING COMMUTE
Dynamic information displayed in Apple Widgets and pop-up notification of informing the trip in advance give passengers a shortcut to understand what’s going on right now.
IN-CAR ENVIRONMENT SETTING
Not only can select prefered seats before getting in, but also be able to adjust temperature and set favourite playlists.
Part 02 / 3
VERIFY SHUTTLE INFO & CHECK TRIPS
Shuttle can only recognize you when you verify your identity by tapping your ID card; however, you can easily understand which one is yours and get started quickly.
The outside screen will display evey information you need to take off.
Part 03 / 3
ENJOY YOUR TRIP & EMERGENCY CONTROL
Combining the shuttle with IIT campus website + Chicago crime data + IIT alert to provide safe and joyful in-car experience for students.
A journey while in SHUTTLE
Robotic Lab conducted road tests on the main campus, and provided the visualized data showing the capacity of AV camera. We understood that shuttle could perceive information of buildings, vehicles in the surrounding environment.
Besides the ability of avoiding collision on road, what else can designers deal with the building, road information? We then conducted user interview mainly discussed IIT students', faculty's desire of on-campus shuttle and their experience of current day-to-day on-campus routine, finding four main opportunities.
In order to satisify these 4 needs, we first explored the basic experience model, listing out the key interaction points happened when user who wished to go from Point A to Point B. then use storyboard to show the proposed scenario.
After we got a clear mind of what we are going to design, we divided into two teams for different tasks -- screen, modeling and animation. Mine was mainly focusing on screen UI and UX. Eventually got a reasonable process by doing 3 rounds of wireframe prototype.
What information should be existing on Mobile APP which can be differentiate from UBER, aiming for serving IIT people?
What process should we go through when we check in the trip?
How to interact with inside screen and how the overlay information layout be above the map system?
Let information live inside the buildings
Due to the high crime rate in southern Chicago, IIT and the University of Chicago have an alarm system. When a dangerous event occurs in/around the campus, the system will notify students via text messages, phone calls, and emails. We interconnect the alarm system with the map, providing a new safe route for them when something bad happened.