empathetic in-car experiences
AI that understands your emotional state

GOAL:
ROLE:
TEAM:
design an emotionally intelligent AI system that understands driver and passenger emotional states, adapting the entire in-cabin experience. my team's goal was to design the listening experience, based on real-time emotional and cognitive awareness
Product Designer, Team Lead (Intern)
HARMAN Innovation Team: AI engineers, product manager, design mentor, and 8 person cross functional intern team (design, research, engineering)
ABOUT SAMSUNG & I
I joined the HARMAN Innovation team to start building toward a new goal: evolving from smart (standalone features) to (empathetic) integrated, intelligent, context aware systems.
I got to lead one of the dimensions of the future of Samsung x HARMAN's emotionally intelligent in-car experience vision: transforming the listening experience based on emotional states. We explored how technology could intuitively understand and respond to the emotional state of the driver, as a new wave of the digital cockpit is designed to be a companion, and to personalize fully to the driver.
We worked on building AI that understands emotional states and adapts the entire in-cabin experience accordingly. This system now powers "Luna," HARMAN's empathetic AI avatar, and integrates across the Ready portfolio (Ready Care's cognitive load monitoring and Ready Vision's augmented reality displays).
Essentially, we designed the point where cars stop being things we control and start being things that understand us. Today, HARMAN’s audio and connected car systems are installed in more than 50 million vehicles on the road worldwide. The emotionally intelligent cabin experience is predicted to be adopted by ~10-15% of luxury vehicles in the next 5 years, and 200M+ vehicles by 2035.
Though I can't share more here, I'd love to expand more in a conversation. Feel free to reach out!
You can learn more about the release here:
HARMAN Redefines In-Cabin Experiences, Turning Cars into Intelligent, Empathetic Companions
DEMO OF THE FIRST VERSION
Take a look at the version of the digital cockpit that was released in 2021, pre-emotional intelligence.