2030s Automotive HMI, Conversational AI, VUI
Hey, Tesla! is an AI-powered Voice UI and Interaction system designed to improve communication between Tesla drivers and vehicles, achieving enhanced situational awareness while driving.
Duration
6 weeks, Nov - Dec 2023
Team
Jacqueline Huo, Claire Li, Diana Lu, and Muji Sawadatikom
My Role
Conversational AI, Voice User Interface, Voice Interaction Prototype (ProtoPie), User Testing
Overview
Problem
90% of traffic crashes caused by human error involve Situational Awareness (SA). Tesla's VUI is non-intuitive, overwhelms users with information, challenging the achievement of Level 2/3 SA.
Goal
Redesign the VUI of Tesla Model 3 with assistive features to enhance communication between drivers and vehicles, bringing value by improving usability and Situational Awareness.
Success Metrics
80%
Prototype Usability
Surveyed to measure the alignment of user mental models with the interactive system’s functionalities and performance.
82%
Situation Awareness(SA) Measurement
Received high numeric scoring on SA, as it frees drivers from searching for restaurants or parking, allowing them to focus on driving.
Key Findings
When users face an inappropriate amount of information,
they struggle to make decisions and feel uncontrollable.
Scenario Consideration
AI Persona
Tesla AI Bot
The Reliable Witty Bot
“Greetings! Might I help you navigate complex
routes and find the perfect parking spot?”
Common Conversation
User
“Hey Tesla, take me to the nearest Starbucks.”
Tesla
“Sure, the closest Starbucks is 15 mins away. Would you like to navigate?”
User
“Yes, please.”
Tesla
“Great, starting navigation to Starbucks.”
[After a few minutes of driving, Tesla detects that the destination is approaching.]
Tesla
“We are almost at Starbucks. Do you need parking suggestions?”
User
“Yes, that would be helpful.”
Tesla
“Alright. The closest parking lot charges $1/hr. Would you like to go there?”
User
“Yes.”
Tesla
“Great, navigating to S Los Robles Parking.
Expect to arrive in 2 mins.”
User
“Thanks Tesla.”
Tesla
“You're welcome! Enjoy your coffee.”
Wake Up Prompt
User
Tap button on the steering wheel
Hey Tesla. / Tesla! / Help Tesla!
Tesla
Hello, how may I assist? / I’m listening...
Navigation Prompt
User
Tesla, take me to the nearest Starbucks?
Automatic suggestions for parking lot
Tesla
We are almost at Starbucks. Do you need parking suggestions?”
Personality
Warmth
Cool
Casual
Formal
Emotional
Neutral
Direct
Sarcastic
Dialogue Script
The conversation is the UI
Time Linearity
Unidirectionality
Invisibility
Adding stops
Finding parking space
Drivers get frustrated when not being able to find a proper parking space.
Ideation
The conversation is the UI
Usability Test
3 levels
SA
Perception
wake up, I am listening
Comprehension
sleep, end of interaction
Forecasting
success, task completed
Final Design
AI Bot(Personality+Prompt+ Conversational Flow, Flow Map)
Tesla AI Bot
Goal
I want to have quick access to essential supplies when I am distant from the city.
Feature 01
Clear Indication of VUI Status + Auditory Feedback):Multi-Modal Interaction
.Earcons + Animations
01
wake up, I am listening
02
sleep, end of interaction
03
success, task completed
04
notification, user attention
Feature 02
High Glanceability
Pattern recognition without extensive cognitive effort.
01
wake up, I am listening
02
sleep, end of interaction
03
success, task completed
04
notification, user attention
Usability Test
Problem 01
Difficulties to add multiple products.
4 out of 5 users had trouble adding
products to cart. They expected to be
able to add multiple items in one cart.
Problem 02
Couldn't see same-store products.
Observed a high frequency of users expressing interest in purchasing multiple products from the same shop.
Final Solution
Enhance clarity & discoverability.
Highlight store information, using primary pink to guide users toward essential actions, and secondary green to enhance visual balance.
Transparent order updates and delivery notifications.
Problem 01
Confusion navigating to track order
After completing checkout, users couldn't find their orders. They expected to track their order status in bottom navigation bar.
Problem 02
Notifications disappear quickly
Users want to read notifications before taking action. They disappear quickly, frustrating users and distracting them from order icon.
Final Solution
"
The motion indication and delivery count
for my current order caught my attention, making it super easy to locate."
Feature 02
Transparent
Feature 03
Motivating
Educate on drone delivery's environmental impact and offer discounts reflecting customers' eco-conscious decisions.
