Embodied Cognition and Film Sound Perception

1. What is Embodied Cognition?

At its core, the theory of embodied cognition proposes that the mind is not an abstract entity separate from the body. Instead, our cognitive processes—including perception, memory, and language—are profoundly shaped by the fact that we have bodies with specific sensory and motor capabilities that interact with a physical environment.

This idea has deep roots in phenomenology, a philosophical tradition that studies lived experience. Let's watch a short video that introduces some key phenomenological concepts that are foundational to embodied cognition.

The video highlights two critical ideas:

1. Pre-reflective Knowledge: Much of what we "know" is not conscious, symbolic information but is instead stored as bodily skills and dispositions. Your experience as a sound mixer involves this constantly—the feel of a fader, the intuitive adjustment of EQ, are forms of "knowledge in the hands."
2. Cross-modal Perception: Our senses are not isolated. What we see informs what we hear and touch, and vice-versa. We perceive a single, unified reality through a fusion of sensory inputs, a concept you'll recognize as related to Chion's idea of synchresis.

2. Image Schemas and Conceptual Metaphors

Building on these phenomenological roots, cognitive scientists like George Lakoff developed a more detailed model of how the body shapes the mind. They argue that we make sense of the world, especially abstract concepts like time, emotion, and logic, by mapping them onto basic, embodied experiences.

To understand this mechanism, let's watch a lecture by Lakoff himself.

From Lakoff's presentation, we can extract two essential concepts for our purposes:

• Image Schemas: These are recurring, dynamic patterns of our bodily experience. They are not rich, detailed images but are more like abstract skeletons of experience, such as CONTAINMENT (in/out), BALANCE, FORCE (compulsion, blockage), and VERTICALITY (up/down).
• Conceptual Metaphors: These are the cognitive mechanisms we use to understand an abstract concept (the target domain) in terms of a more concrete, embodied one (the source domain). For example:
  • ANGER IS HEATED FLUID IN A CONTAINER: We understand the abstract emotion of anger through our physical experience with boiling liquids.
  • MORE IS UP / LESS IS DOWN: We understand quantity through the physical experience of adding to a pile (it gets higher) or draining a container (the level drops).

This framework provides a powerful tool for sound analysis. A sound's rising pitch might metaphorically signify increasing tension (TENSION IS UP). A sudden, loud sound might be perceived through the FORCE schema, giving it a physical impact.

3. Audiovisual Metaphors in Film Sound

Now we can connect this theory directly to film sound. Film sound designers and composers intuitively leverage these embodied metaphors to shape our physical and emotional experience of a film. The following reading provides an excellent academic framework for this.

Fahlenbrach’s analysis shows that film sound doesn't just symbolize emotion; it enacts the physical, embodied experience of that emotion. In The Shining example, the high frequency of Wendy’s voice, the dissonant music, and the contrast with Jack's slow, menacing movements all work together to create an audiovisual gestalt that we experience through the embodied FORCE schema—we feel the pressure, the struggle, the threat on a bodily level.

4. A Sound Designer's Toolkit for Embodied Metaphor

Let's bring this down to the level of production and mixing, connecting it to your own professional experience. The next resource examines how specific sound design choices, particularly the manipulation of dynamics, function as tools for creating embodied metaphorical meaning.

This article frames your practical work as a mixer within a powerful theoretical context. When you increase the loudness of a train to reflect a character's inner turmoil, you are deploying the "psychological tension is loudness" metaphor. When you create a vast, reverberant space for a character's dream, you are using the CONTAINER schema to metaphorically represent the expansiveness of their mind. These are not just technical choices; they are acts of creating embodied meaning that an audience understands on a pre-reflective, physical level.

Conclusion

Today we have journeyed from the brain's cognitive processing to the body's lived experience. We've seen that the perception of film sound is not a passive reception of information but an active, embodied process.

Key Takeaways:

• Embodied cognition argues that our minds are inseparable from our bodies. Our perception and thought are grounded in our physical, sensory-motor interactions with the world.
• We understand abstract concepts like emotion through conceptual metaphors, which map them onto concrete, embodied image schemas (e.g., FORCE, CONTAINER, VERTICALITY).
• Film sound is exceptionally powerful at triggering these embodied responses. Sound design choices regarding dynamics, frequency, and spatiality can activate these schemas and metaphors, allowing us to feel a character's emotional state or the narrative's tension on a physical level.
• Sound practitioners, whether consciously or intuitively, use this "bodily language" of sound to guide the audience's perception and create meaning that resonates far deeper than conscious interpretation.

Preview of the Next Lesson:

We've established that sound perception is both a cognitive and an embodied process, and we've touched on its role in creating emotion. In our next lesson, we will focus more explicitly on this emotional dimension. The learning outcome will be to discuss how cognitive and affective processes interact in the perception of film soundscapes. We will explore how our rational understanding and our immediate emotional responses are constantly in dialogue as we experience a film's world of sound.