samsung

samsung

empathetic in-car experiences

AI that understands your emotional state

shipped. under NDA

shipped. under NDA

shipped. under NDA

GOAL:

ROLE:

TEAM:

design an emotionally intelligent AI system that understands driver and passenger emotional states, adapting the entire in-cabin experience. my team's goal was to design the listening experience, based on real-time emotional and cognitive awareness

Product Designer, Team Lead (Intern)

HARMAN Innovation Team: AI engineers, product manager, design mentor, and 8 person cross functional intern team (design, research, engineering)

ABOUT SAMSUNG & I

I joined the HARMAN Innovation team to start building toward a new goal: evolving from smart (standalone features) to (empathetic) integrated, intelligent, context aware systems.

I got to lead one of the dimensions of the future of Samsung x HARMAN's emotionally intelligent in-car experience vision: transforming the listening experience based on emotional states. We explored how technology could intuitively understand and respond to the emotional state of the driver, as a new wave of the digital cockpit is designed to be a companion, and to personalize fully to the driver.

We worked on building AI that understands emotional states and adapts the entire in-cabin experience accordingly. This system now powers "Luna," HARMAN's empathetic AI avatar, and integrates across the Ready portfolio (Ready Care's cognitive load monitoring and Ready Vision's augmented reality displays).

Essentially, we designed the point where cars stop being things we control and start being things that understand us. Today, HARMAN’s audio and connected car systems are installed in more than 50 million vehicles on the road worldwide. The emotionally intelligent cabin experience is predicted to be adopted by ~10-15% of luxury vehicles in the next 5 years, and 200M+ vehicles by 2035.

Though I can't share more here, I'd love to expand more in a conversation. Feel free to reach out!

DEMO OF THE FIRST VERSION

Take a look at the version of the digital cockpit that was released in 2021, pre-emotional intelligence.