Immersive Sound in Film

1. From an Observed Space to an Inhabited Space

The most significant leap in creating immersive sound was the move from a single sound source to multiple sources surrounding the audience. This fundamentally changed the relationship between the listener and the film's sonic world. An excellent academic text by Dong Liang provides a powerful conceptual framework for understanding this shift.

Liang’s distinction provides us with two precise analytical categories:

• Embedded Space: This is the space evoked by a single sound source (i.e., monophonic sound). The spatial characteristics—depth, distance, reverberation—are embedded within the recording itself. The auditorium is treated as irrelevant or as a neutral vessel. The listener perceives a space that is fundamentally over there, on the other side of the screen. We are observers looking and listening into a world.

• Embodying Space: This space is constructed through the strategic deployment of multiple sound sources (speakers) physically located around the listener. It is a space centered on the auditor’s body. The actual physical space of the auditorium becomes a critical component in realizing the sonic world. The listener is positioned within this space, which descends upon them from all directions.

This conceptual shift from an embedded to an embodying space is the theoretical goal of all surround sound and spatial audio technologies.

The effectiveness of this shift is not just theoretical. Empirical studies have shown that as audio technology moves from monophonic (embedded) to surround (embodying), audiences report a greater sense of immersion.

2. The Technological Framework: Channels vs. Objects

Now that we have the conceptual goal—to create an "embodying space"—let's examine the two primary technological methods used to achieve it: channel-based and object-based audio. The essay by Dong Liang also offers a clear historical and technical overview of this progression, especially with the advent of digital cinema.

Let's break down these two approaches. Your background as a mixer will make these distinctions very clear.

Channel-Based Audio (e.g., 5.1, 7.1 Surround)

In a channel-based workflow, the sound designer creates a finite number of audio tracks (e.g., 5.1 has six channels: Left, Center, Right, Left Surround, Right Surround, and Low-Frequency Effects). Each track is mixed and "baked into" the final soundtrack, destined for a specific speaker in a standardized layout.

• Strengths: A massive leap over mono and stereo, enabling the first true "embodying spaces" by placing sounds behind and to the sides of the audience.
• Limitations:
  • Inflexibility: The mix is fixed. It assumes the playback theater has a speaker layout identical to the mixing stage. The reliability of the spatial effect degrades in non-standard rooms.
  • Panning Issues: Moving a sound across the room involves cross-fading it between channels. This can create a "ping-pong" effect where the sound seems to jump between speakers rather than move smoothly through space.

Object-Based Audio (e.g., Dolby Atmos, DTS:X)

Object-based audio represents a complete paradigm shift. Instead of mixing to a fixed number of channels, the sound designer works with up to 128 individual audio elements, or "objects."

• How it Works: Each object is a sound file bundled with metadata that describes its desired position, movement, and size within a virtual 3D space. This entire package—the objects and their metadata—is sent to the cinema. A powerful processor in the theater, the Rendering and Monitoring Unit (RMU), reads this data and renders the soundscape in real-time, intelligently distributing the sound objects across the specific speaker array available in that particular auditorium.
• Strengths:
  • Adaptability & Consistency: The mix is no longer fixed. It adapts to the room, providing a much more consistent experience across different theaters.
  • Precise Spatialization: A sound object can be placed anywhere in the 3D space, not just where a speaker happens to be. The RMU creates a "phantom image" of the sound between speakers, allowing for incredibly smooth and realistic movement.
  • Creative Freedom: Designers can think in terms of space and placement ("I want this sound to fly from the back-left corner over the audience's head") rather than being constrained by channel assignments.

In practice, object-based formats like Dolby Atmos use a hybrid approach. They retain channel-based "beds" for ambient and continuous sounds (like room tone or musical scores) while using objects for dynamic, localized sounds (like dialogue, sound effects, or specific musical elements).

3. Practical Application: Point-Source vs. Distributed Sound

Let's consider how these technologies are used in practice. A sound designer must decide how to treat each element in a mix. Are some sounds meant to envelop the listener generally, while others are meant to come from a very specific point?

Glenn's two categories map directly onto the tools we've been discussing:

1. Distributed Audio: This is sound meant to be heard by everyone equally, creating a general ambiance or environment. This corresponds to the channel-based beds in an Atmos mix. The goal is to create a sense of envelopment. As Glenn notes, simply sending the same mono or stereo file to all speakers is a bad idea, as it creates phasing and comb-filtering issues. A good immersive mix will use decorrelated or multichannel ambient recordings to fill the space without these artifacts.

2. Point Source Audio: This is sound that emanates from a clearly discernible source, drawing the listener's focus. This corresponds perfectly to sound objects in an Atmos mix. The sound of a character's voice, a passing vehicle, or a ricocheting bullet are treated as point-source objects to be placed and moved precisely within the 3D embodying space.

Think of the sound design in Dune, which we've discussed previously. The vast, groaning sounds of the shifting desert sands would be treated as distributed audio in the surround and overhead beds to create a constant, enveloping sense of place. In contrast, the otherworldly "Voice" used by the Bene Gesserit, or the distinct flapping and purring of an ornithopter's wings as it flies overhead, would be treated as point-source objects, rendered with precision to create a visceral, immersive effect.

Conclusion

Today, we have connected the theoretical goal of immersion with the specific technologies used to achieve it. We've seen how cinema sound has evolved to create not just a soundscape to be observed, but an "embodying space" for the audience to inhabit.

Key Takeaways:

• The evolution of film sound technology reflects a shift from creating an embedded space (observed from a distance) to an embodying space (constructed around the listener).
• Channel-based surround (5.1/7.1) was the first major step toward an embodying space, assigning discrete audio tracks to a fixed array of speakers.
• Object-based spatial audio (Dolby Atmos) is a revolutionary step further. It uses sound objects with metadata, which are rendered in real-time to fit the specific speaker layout of a theater, allowing for unparalleled precision, smoothness, and consistency in spatialization.
• Sound designers use a combination of distributed audio (ambiant beds) and point-source audio (dynamic objects) to construct these complex, immersive sonic worlds.

Preview of the Next Lesson:

Having established the broad technological framework for creating immersive spaces, our next lesson will zoom in on some of the most fundamental—and often overlooked—components of the soundscape. We will examine the specific roles that ambient sound, room tone, and silence play in constructing a believable sense of place and manipulating the audience's sense of immersion.