Date: May 2013
Creator: Narvaez-Valle, Alexis
Description: Different ways to measure human affective and deceptive reactions to stimulus have been developed. One method is a multimodal approach using web camera, thermal imaging camera and physiological sensors data to extract different features in the human face (verbal and non-verbal behavior) such as breathing rate, heart rate, face temperature, skin conductance, eye tracking, language analysis and facial expressions among others. Human subjects from different ages and ethnicity were exposed to two different experiments were they watched videos (affection recognition) and others answered an interview session (deception recognition). With the data collected from videos (thermal and visual), different regions of interest (ROI) of the face were selected as well as the whole picture. The ROI were determined based on the most sensitive parts of the face where larger changes of temperature or other physiological features are recorded. It was also analyzed the language (written and spoken) in order to obtain the verbal modalities. The data has been compared among the subjects to determine whether the deceptive and affective reactions of a person can be predicted using multimodal approach. From the multiple data obtained, a characterization of reactions is proposed when subjects are exposed to different stimulus, positive or negative, as ...
Contributing Partner: UNT Libraries