Title

Objectivization of Audio- Visual Correlation Analysis

Journal title

Archives of Acoustics

Yearbook

2012

Volume

vol. 37

Issue

No 1

Authors

Kostek, Bożena ; Kunka, Bartosz

Keywords

sound perception ; sound source localization ; virtual sound source shifting ; bi-modal perception ; cross-modal perception ; image proximity effect ; ventriloquism effect ; visual attention ; perceptual illusion ; eye-gaze tracking

Divisions of PAS

Nauki Techniczne

Coverage

63-72

Publisher

Polish Academy of Sciences, Institute of Fundamental Technological Research, Committee on Acoustics

Date

2012

Type

Artykuły / Articles

Identifier

DOI: 10.2478/v10168-012-0009-4

Source

Archives of Acoustics; 2012; vol. 37; No 1; 63-72

References

Abel A. (2009), Maximising Audiovisual Correlation with Automatic Lip Tracking and Vowel Based Segmentation, 16. ; Bech S. (1995), Interaction Between Audio-Visual Factors in a Home Theater System: Experimental Results, null. ; Beerends J. (1999), The Influence of Video Quality on Perceived Audio Quality and Vice Versa, Journal of the Audio Engineering Society, 47, 5, 355. ; Beerends J. (1992), A perceptual audio quality measure based on a psychoacoustic sound representation, J. Audio Eng. Soc., 40, 12, 963. ; Bertelson P. (1998), Advances in psychological science, 1. Biological and cognitive aspects, 419. ; Bertelson P. (1981), Cross-modal bias and perceptual fusion with auditory-visual spatial discordance, Perception and Psychophysics, 29, 6, 578, doi.org/10.3758/BF03207374 ; Bogdanowicz M. (2000), <i>Perceptual-motor integration, theory - diagnosis - therapy</i> [in Polish], Methodological Centre for Psychological and Pedagogical, issue III. ; Brook M. (1984), Wie bewertet der Zuschauer das stereofone Fernsehes [in German], null, 367. ; Chen T. (1998), Audio-visual integration in multimodal communication, Proceedings of the IEEE, 86, 5, 837, doi.org/10.1109/5.664274 ; Davis E. (1999), Can audio enhance visual perception and performance in a virtual environment?, null. ; Gardner M. (1968), Proximity image effect in sound localization, J. Acoust. Soc. Amer., 43, 163, doi.org/10.1121/1.1910747 ; Hollier M. (1997), Objective performance assessment: video quality as an influence on audio perception, null. ; ITU-R BS. 1116-1 (1994-1997), <i>Methods for the subjective assessment of small impairments in audio systems including multichannel sound systems.</i> ; ITU-R BS. 1286 (1997), <i>Methods for the subjective assessment of audio systems with accompanying picture.</i> ; Kin M. (2011), Comparison of sound attributes of multichannel and mixed-down stereo recordings, Archives of Acoustics, 36, 2, 333, doi.org/10.2478/v10168-011-0025-9 ; Klonari D. (2011), Loudness assessment of musical tones equalized in A-weighted level, Archives of Acoustics, 36, 2, 239, doi.org/10.2478/v10168-011-0019-7 ; Komiyama S. (1989), Subjective evaluation of angular displacement between picture and sound directions for HDTV sound systems, J. Audio Eng. Soc., 37, 4, 210. ; Kostek B. (2005), Perception-based data processing in acoustics. Applications to music information retrieval and psychophysiology of hearing, 389. ; Kostek B. (2011), Retrospecting Polish Audio Engineering Society membership on 20th anniversary of the Polish Section of the Audio Engineering Society, Archives of Acoustics, 36, 2, 187, doi.org/10.2478/v10168-011-0016-x ; Kunka B. (2009), A new method of audio-visual correlation analysis, null, 4, 497. ; Kunka B. (2010a), Exploiting audio-visual correlation by means of gaze tracking, International Journal of Computer Science and Applications, 7, 3, 104. ; Kunka B. (2010b), Objectivization of audio-video correlation assessment experiments, null. ; Kunka B. (2010), Gaze-tracking based audio-visual correlation analysis employing quality of experience methodology, Intelligent Decision Technologies Journal, 4, 3, 217. ; Lee J. (2010), Efficient video coding based on audio-visual focus of attention, Journal of Visual Communication and Image Representation, Elsevier. ; Lewald J. (1997), Eye-position effects in directional hearing, Behavioural Brain Research, 87, 35, doi.org/10.1016/S0166-4328(96)02254-1 ; Lewald J. (1998), Auditory-visual spatial integration: a new psychophysical approach using laser pointing to acoustic targets, J. Acoust. Soc. Am., 104, 3, 1586, doi.org/10.1121/1.424371 ; Liu Y. (2008), Recovering audio-to-video synchronization by audio-visual correlation analysis, null. ; McGurk H. (1976), Hearing lips and seeing voices, Nature, 264, 746, doi.org/10.1038/264746a0 ; Mujal M. (2002), Compression enhancement of video motion of mouth region using joint audio and video coding, null. ; Nakayama Y. (2003), <i>A method of</i> 3-<i>D sound image localization using loudspeaker arrays</i>, null. ; Rao R. (1998), Exploiting audio-visual correlation in coding of talking head sequences, IEEE Trans. on Industrial Electronics, 45, 1, 15. ; Rakowski A. (2010), Pitch strength of residual sounds estimated through chroma recognition by absolute-pitch possessors, Archives of Acoustics, 35, 3, 331, doi.org/10.2478/v10168-010-0028-y ; Rakowski A. (2011), Absolute pitch and its frequency range, Archives of Acoustics, 36, 2, 251, doi.org/10.2478/v10168-011-0020-1 ; Rorden C. (1999), Does auditory attention shift in the direction of an upcoming saccade?, Pergamon, Neuropsychologia, 37, 357, doi.org/10.1016/S0028-3932(98)00072-4 ; Rutkowska L. (2005), Statistical data analysis employing STATISTICA program [in Polish], Lecture Notes, Forestry Faculty. ; Sabin A. (2011), Weighting-Function-Based Rapid Mapping of Descriptors to Audio Processing Parameters, J. Audio Eng. Soc., 59, 6, 419. ; Sitek A. (2011), Study of preference for surround microphone techniques used in the recording of choir and instrumental ensemble, Archives of Acoustics, 36, 2, 365, doi.org/10.2478/v10168-011-0027-7 ; Storms R. (2000), Interactions in perceived quality of auditory-visual displays, Presence: Teleoperators and Virtual Environment, 9, 6, 557, doi.org/10.1162/105474600300040385