Automotive User Interfaces
For:
Jaguar, Ford, Mercedes-Benz, Volvo
(employed by suppliers Dragon Systems and Mitsubishi Electric)
From:
2000–06
Roles:
Software engineer; technical project manager; user interface prototyper
Features:
Command-and-control and voice search for safe(r), standards-compliant car navigation & entertainment
Deliveries:
Speech recognition grammars and localizations; technical and tracking documents in both English and German; prototype/demo software showing novel multimodal voice search techniques
2006 Mercedes C-Class (photo by The Car Spy on Flickr)
For:
FiatChrysler, Ford, Hyundai
(employed by supplier Nuance Communications)
From:
2010–13
Roles:
Software engineer; technical team lead
Features:
FiatChrysler: flexible natural language understanding (NLU) in a small-footprint embedded system
Ford, Hyundai: low-distraction multimodal (voice + X) interfaces
Deliveries:
NLU data and configuration files; driver distraction research prototypes; trade show (CES) demo apps
Schematic of “Bullseye” low-distraction voice + gestural prototype
For:
Apple
From:
2013–25
Roles:
Design lead for Siri in car (2013–17); design lead for invocation and feedback (2018–25)
Features:
Conversational voice interface with GUI shortcuts (buttons, list items, notifications)
Auditory feedback and microphone capture that “just work” across heterogeneous CarPlay configurations
Deliveries:
human factors guidance, multimodal UI prototypes, voice UI specifications, audiovisual mockups, timeline and activity diagrams
