We Were Children Once: Crafting Narrative and Emotional Immersion through XR Soundscapes
Published
20-9-2025
Type of Work
Conference Presentation
Abstract
Sound design is an under-researched and crucial aspect of extended reality (XR) where little is currently known about best practice. XR is a unique medium, positioned between several better-explored media forms—cinema, games and theatre. Although these well-known disciplines may have much practical wisdom to offer sound designers in XR, there is scant literature available to guide practitioners about how to best adapt their skills and experience to this new format. In the quest for a new language of sound in XR, this paper explores how sound practices from the disciplines of cinema, games, and theatre can contribute to sound for extended reality.
The findings discussed were gained from the production of a 15-minute virtual reality film entitled ‘We Were Children Once’. The paper is supported by a literature review and unpublished interviews with leading sound designers who have backgrounds in cinema, games, or theatre, and who are currently working in XR. These findings detail the practical considerations of on-set sound recording, the meticulous requirements of an XR dialogue edit (and the AI tools making it easier), the software advances in spatial sound plugins, the use of generative AI voices in documentary, the problematic lack of bass in headphone playback, and the designers’ differing approaches to creative sound design in the studio.
This paper will also contribute the directorial perspective, exploring the process of how sound becomes an essential tool for shaping both narrative and emotional immersion of a particular project. It will be argued that in virtual reality and other forms of immersive mediums, sound does more than accompany images — it anchors the viewer, directing their attention and helping them orient themselves within the story world but more importantly grounding them in reality of the environment. This process requires not only technical precision but a deep understanding of how sound can evoke memory, shift mood, and give voice and meaning to environments and characters. The paper will explore the creative collaboration between director and sound designer detailing how sound is amplified in XR, where the boundaries between sound, space, and story constantly blur.
The creative practices developed in this research project could be used by sound designers and directors in the creative design and development of XR soundscapes to create more engaging and impactful virtual reality experiences.
Citation
Butterworth, A., Hegedus, P. (2025). We Were Children Once: Crafting Narrative and Emotional Immersion through XR Soundscapes [Conference Presentation]. Sightlines 2025. Adelaide, Australia.