The perception of audio spatialization during cinematic immersion: an HD-EEG study on the sense of Presence

Abstract

Although many studies have investigated spectators’ cinematic experience, only a few of them explored the neurophysiological correlates of the sense of Presence evoked by the spatial characteristics of audio delivery devices. Nevertheless, nowadays both the industrial and the consumer markets have been saturated by some forms of spatial audio format that enrich the audio-visual cinematic experience, reducing the gap between the real and the digitally mediated world. The increase in the immersive capabilities correspond to the instauration of both the sense of Presence, the psychological sense of being in the virtual environment, and embodied simulation mechanisms. While it is well known that these mechanisms can be activated in the real world, they may be elicited even in virtual environments and could be modulated by the acoustic spatialization cues reproduced by sound systems. Hence, the present study aims to investigate the neural basis of the sense of Presence, together with the emotional and physical involvement, evoked by different forms of mediation by testing different sound delivery presentation modes (Monophonic, Stereophonic and Surround). To these aims, a behavioral investigation and a high-density electroencephalographic (HD-EEG) study have been developed. A large set of ecological and heterogeneous stimuli extracted from feature movies were used. Furthermore, 32 participants were selected following the Generalized listener selection procedure. We found a significant event-related desynchronization (ERD) in the Surround condition when compared to the Monophonic condition both in Alpha and Low Beta centro-parietal clusters. We discuss the results as an index of embodied simulation mechanisms that could be considered as a possible neurophysiological correlate of the instauration of the sense of Presence.