Hello! Welcome to the third lesson in our module on "Measuring the Unconscious Consumer."
In our last lesson, we explored eye-tracking, a powerful tool for understanding where people direct their visual attention. We discussed how metrics like heatmaps and gaze paths can reveal what parts of an ad or website are being seen. However, we also noted a key limitation: eye-tracking tells us what people look at, but not how they feel about what they see.
Today, we address that gap. Our focus is on a foundational technique for measuring emotion by analyzing the face. Your learning outcome for this lesson is to explain the concept of Facial Action Coding System (FACS) as a method for objectively measuring emotional expression.
This is a crucial tool in neuromarketing. For you, in a role that involves understanding and influencing customer behavior, being able to grasp the science behind a customer's genuine emotional reaction—as opposed to what they might say out of politeness—is a significant advantage. It helps answer the "why" behind their choices and provides a more authentic layer of feedback on your marketing and sales efforts.
1. The Face as a Window to Unconscious Emotion
We intuitively know that our faces can give away our feelings. A fleeting frown, a brief flash of surprise, or the crinkle around the eyes in a genuine smile often communicate more than words. In the 1960s, a psychologist named Paul Ekman began to scientifically prove and systematize this idea. He found that certain core emotional expressions were universal across all human cultures.
However, these expressions, especially the most genuine and fleeting ones called "micro-expressions," happen so fast that most people can't reliably spot or interpret them. This led Ekman to develop a standardized, objective method to deconstruct any facial movement.
Let's start with a basic introduction to this method.
What is facial coding and how does it work? - Certamente
The article 'What is facial coding and how does it work?' from Certamente provides a clear overview of the origins and purpose of FACS.
Please read the introduction and the section 'What is FACS, or Facial Coding'. Focus on why the system was created and the problem it was designed to solve.
As the article notes, the goal was to create a system to move beyond subjective guesswork and build a rigorous, repeatable way to analyze the face. This system is the Facial Action Coding System (FACS).
2. The Building Blocks of Expression: Action Units (AUs)
The genius of FACS is that it doesn't try to interpret emotion directly. Instead, it atomizes facial expressions into their smallest components: individual muscle movements. Each of these anatomically distinct movements is called an Action Unit (AU).
Think of it like letters in an alphabet. Single letters (AUs) don't have much meaning on their own, but when you combine them, you can form words and sentences (emotional expressions).
To understand this concept, it's best to hear from the creator himself.
The Development of the Facial Action Coding System - Part 1
In this video, 'The Development of the Facial Action Coding System', Dr. Paul Ekman explains the anatomical basis of FACS. He describes how he had to create a 'functional anatomy' of the face to account for all possible movements.
Please watch from 04:43 to 13:03. Pay close attention to how he explains that facial movements are the result of muscles pulling on skin, creating changes like wrinkles and bulges. Then, listen to how he describes the core purpose of FACS: to precisely describe any facial movement and compare expressions across different people.
As Dr. Ekman explained, FACS is fundamentally a descriptive tool. Its job is to objectively record what the face is doing. For example, instead of a coder writing "looks happy," they would record the specific Action Units they observe, such as:
- AU 6: Cheek Raiser and Lid Compressor (causes "crow's feet" wrinkles)
- AU 12: Lip Corner Puller (the main action in a smile)
By combining these codes, you can precisely describe an expression. Let's look at some visual examples.
Now see how these AUs combine to form expressions we all recognize.
The key takeaway is that FACS provides a common, objective language. It ensures that when one researcher talks about a "smile," they are talking about the exact same combination of muscle movements as another researcher, removing ambiguity.
3. A Practical Example: The "Duchenne" Smile
One of the most famous and useful insights from this work is the ability to distinguish a genuine, felt smile from a polite, social one. This has direct relevance in any field where understanding true sentiment matters, from sales to marketing.
Dr. Ekman named the genuine smile after the 19th-century French neurologist Guillaume Duchenne, who first identified its key components.
Let's return to the video to hear Dr. Ekman explain this discovery.
The Development of the Facial Action Coding System - Part 1
Here, Dr. Ekman discusses the work of Duchenne and the crucial muscle movement that separates a real smile of enjoyment from a fake or polite one.
Please watch from 18:46 to 22:09. Focus on the role of the muscle that orbits the eye (orbicularis oculi) and why its involuntary nature is the key to identifying a genuine smile.
This is a perfect concept to practice communicating. In simple terms:
- A social or polite smile involves only the muscles that pull the lip corners up (AU 12). Most people can do this voluntarily.
- A genuine smile of enjoyment (a "Duchenne" smile) involves both the lip corner puller (AU 12) and the involuntary contraction of the muscles around the eyes (AU 6), which creates crow's feet.
When you're trying to explain this to a colleague, you can simplify it to: "Look for the crinkle around the eyes. That's the part of the smile people can't fake, and it tells you if their happiness is genuine."
Test your understanding!
You're reviewing two versions of a TV commercial. In both versions, the actors smile when using the product. In Version A, the focus group's facial coding data shows high activation of AU 12. In Version B, the data shows high activation of both AU 12 and AU 6.
Which version of the commercial is likely eliciting a more genuine positive emotional response, and why?
Show answer
Version B is eliciting a more genuine response. The presence of both AU 12 (Lip Corner Puller) and AU 6 (Cheek Raiser, causing eye crinkling) indicates a Duchenne smile, which is a reliable marker of true enjoyment. Version A's smile, showing only AU 12, is more likely a polite or "social" smile.
4. Facial Coding in Modern Marketing
Manually coding every frame of a video for dozens of AUs is incredibly time-consuming. Today, neuromarketing firms use artificial intelligence and machine learning to do this automatically. By using a simple webcam, software can track a person's face as they watch an ad or browse a website and translate their muscle movements into emotional data in real-time.
This makes the technique scalable for market research. Let's look at how it's applied.
Emotional Marketing: Elicit Emotions to Stand Out
This article from EyeSee Research and the previous Certamente article explain how FACS is used in a business context, often with the help of technology.
Please read the section 'How facial expressions are scored: FACS' and the following short section on cognitive emotions. Note how the basic AUs are grouped into emotional categories and the addition of 'interest' and 'confusion' for marketing research.
What is facial coding and how does it work? - Certamente
Now, let's revisit the Certamente article to see how facial coding is deployed in practice.
Please read the section 'Neuromarketing and Facial Coding'. Focus on how software and webcams make this research possible and how it's often combined with other tools like eye-tracking.
As these resources highlight, the applications in marketing are powerful:
- Ad Testing: Get a moment-by-moment emotional analysis of a video ad to see which scenes create joy, surprise, or confusion.
- Product Experience: Measure the delight or frustration a person feels while unboxing or using a product.
- Website Usability: Identify points of confusion (furrowed brows, AU 4) or interest (raised brows, AU 1+2) as a user navigates a website.
The combination with eye-tracking, which you learned about previously, is particularly insightful. You can know not only where they looked (eye-tracking) but also how they felt when they looked there (facial coding).
Conclusion
Today you've learned about the Facial Action Coding System (FACS), the gold standard for objectively measuring emotional expressions. You've moved beyond the limitation of eye-tracking to understand not just attention, but also the emotional valence (positive or negative feeling) associated with that attention.
Key Takeaways:
- FACS is an objective, anatomical system for describing any visible facial muscle movement, not a subjective interpretation of emotion.
- It breaks down complex expressions into Action Units (AUs), which are the fundamental building blocks of facial movements.
- FACS can be used to identify reliable markers of genuine emotion, such as the Duchenne smile (AU 6 + AU 12), which indicates true happiness.
- In modern marketing, automated facial coding software uses this system to provide scalable, real-time feedback on consumer emotional responses to ads, products, and digital experiences.
As you continue to build your expertise, being able to explain that you can measure not just what people say they feel, but what their involuntary facial muscles show they feel, will be a powerful way to communicate the value of a neuroscientific approach to marketing.
Preview of Next Lesson:
We've measured attention with eye-tracking and emotional expression with facial coding. But what about the mental effort or excitement happening inside the brain? In our next lesson, we will explore Electroencephalography (EEG), a tool that measures electrical activity in the brain to reveal metrics like cognitive load and engagement, giving us yet another layer of insight into the consumer mind.