A research on facial visual-infrared stereo vision fusion measurement for internal state estimation
Our main aim is to propose a vision-based measurement as an alternative to physiological measurement for recognizing mental stress. The development of this emotion recognition system involved three stages: experimental setup for vision and physiological sensing, facial feature extraction in visual-t...
à®®à¯à®´à¯ விளகà¯à®•à®®à¯
Saved in:
| தலைமை எழà¯à®¤à¯à®¤à®¾à®³à®°à¯: | |
|---|---|
| வடிவமà¯: | Thesis |
| வெளியீடபà¯à®ªà®Ÿà¯à®Ÿà®¤à¯: |
2015
|
| பகà¯à®¤à®¿à®•à®³à¯: | |
| நிகழà¯à®¨à®¿à®²à¯ˆ அணà¯à®•à®²à¯: | http://eprints.uthm.edu.my/7892/ http://eprints.uthm.edu.my/7892/1/mohd_norzali_mohd.pdf |
| கà¯à®±à®¿à®¯à¯€à®Ÿà¯à®•à®³à¯: |
கà¯à®±à®¿à®šà¯à®šà¯Šà®²à¯ இணை
கà¯à®±à®¿à®¯à¯€à®Ÿà¯à®•à®³à¯ இலà¯à®²à¯ˆ, இநà¯à®¤ கà¯à®±à®¿à®šà¯à®šà¯Šà®²à¯à®²à¯ˆ à®®à¯à®¤à®²à®¿à®²à¯ பதிவ௠செயà¯à®¯à¯à®™à¯à®•à®³à¯!
|
| தொகà¯à®ªà¯à®ªà¯: | Our main aim is to propose a vision-based measurement as an alternative to
physiological measurement for recognizing mental stress. The development of this emotion
recognition system involved three stages: experimental setup for vision and physiological
sensing, facial feature extraction in visual-thermal domain, mental stress stimulus
experiment and data analysis based on Support Vector Machine (SVM). In this thesis, 3
vision based measurement and 2 physiological measurement was implemented in the
system. Vision based measurement in facial vision domain consists of 3 ROI' s temperature
value and blood vessel volume at supraorbital area. Two physiological measurement were
done to measure the ground value which is heart rate and salivary amylase level. We also
propose a new calibration chessboard attach with fever plaster to locate calibration point
in stereo view. A new method of integration of two different sensors for detecting facial
feature in both thermal and visual is also presented by applying nostril mask, which allows
one to find facial feature namely nose area in thermal and visual domain. Extraction of
thermal-visual feature images was done by using SIFT feature detector and extractor to
verify the method of using nostril mask. Based on the experiment conducted, 88.6% of
correct matching was detected. In the eyes blinking experiment, almost 98% match was
detected successfi.dly for without glasses and 89% with glasses. Graph cut algorithm was
applied to remove unwanted ROI. The recognition rate of 3 ROI's was about 90-96%. We
also presented new method of automatic detection of blood vessel volume at Supraorbital
monitored by LWIR camera. The recognition rate of correctly detected pixel was about
93%. An experiment to measure mental stress by using the proposed system based on SVM
classification had been proposed and conducted and showed promising results. |
|---|