Audiovisuelle SprachwahrnehmungAudiovisual Speech Perception

Audiovisual speech perception

Speech information is not only perceived via the auditory system, but also visually. Especially in noisy environments there is often the need to use additional visual speech information. In particular persons with hearing impairment require visual speech information in order to compensate for a lack of auditory features.

We focus on the questions for which audiological testing it might be useful to include visual speech information and how audiovisual speech perception might be measured reliably within a clinical setting. Our hypothesis is that, in particular for combining acoustic and electric hearing (as with bimodal or hybrid fitting), the benefit of adding spectro-temporal fine structure might be better represented through audiovisual speech tests compared to conventional speech audiometry. This holds at least as long as the different cues (envelope information, fine structure, visual speech) provide complementary information. Since no validated audiovisual speech tests are available in the German language we use a computer-animated articulatory model that provides visual speech information ("talking head"). This enables us to visualise arbitrary speech materials in a standardised and validated manner.



Selected publications:


Schreitmüller S, Frenken M,Lipski S, Walger M, Meister H. (2013) Audiovisuelle Sprachwahrnehmung I: Sprachverständlichkeitsfunktionen Normalhörender und CI –Träger. DGA Jahrestagung 2013, Rostock, Z. Audiol. Suppl.


Meister H, Schreitmüller S, Pyschny V, Lang-Roth R, Walger M, Fagel S (2011) Untersuchungen audio-visuellen Sprachwahrnehmung Personen mit Hörstörungen mittels virtuellem Kopfmodell. DGA Jahrestagung 2011, Jena, Z. Audiol. Suppl

Top ©