Publications
• Sorted by Date • Classified by Publication Type • Classified by Research Category • Classified by Research Group • Classified by Author Last Name •
Matthias Wimmer, Björn Schuller, Dejan Arsic, Bernd Radig, and Gerhard Rigoll. Low-level Fusion of Audio and Video Feature for Multi-modal Emotion Recognition. In 3rd International Conference on Computer Vision Theory and Applications (VISAPP), pp. 145–151, Madeira, Portugal, January 2008.
Download
Abstract
Bimodal emotion recognition through audiovisual feature fusion has been shown superior over each individual modality in the past. Still, synchronization of the two streams is a challenge, as many vision approaches work on a frame basis opposing audio turn- or chunk-basis. Therefore, late fusion schemes such as simple logic or voting strategies are commonly used for the overall estimation of underlying affect. However, early fusion is known to be more effective in many other multimodal recognition tasks. We therefore suggest a combined analysis by descriptive statistics of audio and video Low-Level-Descriptors for subsequent static SVM Classification. This strategy also allows for a combined feature-space optimization which will be discussed herein. The high effectiveness of this approach is shown on a database of 11.5h containing six emotional situations in an airplane scenario.
BibTeX Entry
@inproceedings{ wimmer08lowlevel,
author = {Matthias Wimmer and Bj\"orn Schuller and Dejan Arsic and Bernd Radig and Gerhard Rigoll},
title = {Low-level Fusion of Audio and Video Feature for Multi-modal Emotion Recognition},
booktitle = {3rd International Conference on Computer Vision Theory and Applications~(VISAPP)},
year = {2008},
month = {January},
address = {Madeira, Portugal},
volume = {2},
pages = {145-151},
bib2html_pubtype = {Refereed Conference Paper},
bib2html_rescat = {Image Understanding},
bib2html_groups = {IU},
abstract =
{Bimodal emotion recognition through audiovisual feature fusion has been shown superior over each individual modality in the past. Still, synchronization of the two streams is a challenge, as many vision approaches work on a frame basis opposing audio turn- or chunk-basis. Therefore, late fusion schemes such as simple logic or voting strategies are commonly used for the overall estimation of underlying affect. However, early fusion is known to be more effective in many other multimodal recognition tasks.
We therefore suggest a combined analysis by descriptive statistics of audio and video Low-Level-Descriptors for subsequent static SVM Classification. This strategy also allows for a combined feature-space optimization which will be discussed herein. The high effectiveness of this approach is shown on a database of 11.5h containing six emotional situations in an airplane scenario.},
}
Generated by bib2html.pl (written by Patrick Riley ) on Sat Nov 29, 2008 01:35:44 UTC
















