文章基本信息

标题：Coherence Research of Audio-Visual Cross-Modal Based on HHT
本地全文：下载
作者：Zhu, Xiaojun ; Hu, Jingxian ; Ma, Xiao 等
期刊名称：Journal of Multimedia
印刷版ISSN：1796-2048
出版年度：2014
卷号：9
期号：2
页码：230-237
DOI：10.4304/jmm.9.2.230-237
语种：English
出版社：Academy Publisher
摘要：Visual and aural modes are two main manners that human utilize to senses the world. Their relationship is investigated in this work. EEG experiments involving mixed aural and visual modes are designed, utilizing Hilbert-Huang Transform (HHT) and electroencephalogram (EEG) signal processing techniques. During EEG data processing, I-EEMD method of similar weighted average waveform extension is proposed to decompose the EEG signals, specifically accounting for the problem of end effects and mode mixing existing in the traditional HHT. The main components of are obtained after decomposing the signals including mixed modes with I-EEMD respectively. The correlation coefficient of consistent and inconsistent mixed signal is calculated, and the comparison is made. Investigation on the comparison condition of the correlation coefficient indicates that there is coherence in both the visual and aural modes
关键词：EEG;Audio-visual;Coherence;HHT;EEMD