GTC Silicon Valley-2019: Multimodal Affects Analysis: The Future of the Autonomous Vehicle In-Cabin Experience
GTC Silicon Valley-2019 ID:S9466:Multimodal Affects Analysis: The Future of the Autonomous Vehicle In-Cabin Experience
Mohammad Mavadati(Affectiva),Taniya Mishra(Affectiva)
Autonomous vehicles will require in-cabin sensing to respond to user activities and emotional states. This session will provide an overview of Affectiva's Emotion AI technology to redefine the in-cabin experience. We will describe the progression of unimodal analysis of face and voice emotions to the fusion of these modalities to detect affective states, such as frustration. This process employs techniques such as deep learning-based spatio-temporal modeling, in addition to large-scale natural datasets -- made larger still by cross-domain augmentation -- to develop AI systems that can detect these affective states.