Hello! Welcome to the third lesson in our module on the mathematical foundations of probability. In our last session, we refreshed our single-variable calculus skills and saw how integration allows us to calculate probabilities and expected values for a single continuous random variable from its probability density function (PDF).
But what happens when we're interested in two or more random variables at the same time? For instance, we might want to model the joint probability of a person's height and weight, or the x and y coordinates of a dart hitting a board. To tackle these multidimensional scenarios, we need to extend integration into higher dimensions. This brings us to the topic of double integrals.
In this lesson, you will learn how to evaluate double integrals over both simple rectangular regions and more complex, non-rectangular regions. Mastering this technique is essential, as it forms the bedrock for working with joint distributions of multiple continuous random variables, a topic we will explore in depth later in the course.
Double Integrals Over Rectangular Regions
Let's start with the most straightforward case: integrating a function of two variables, , over a rectangular region defined by and . We write this as:
The symbol represents an infinitesimally small area element in the xy-plane.
We evaluate this by computing an iterated integral, where we integrate with respect to one variable at a time, working from the inside out. The following video provides a clear, step-by-step walkthrough of this process.
This video from The Organic Chemistry Tutor provides a practical introduction to evaluating double integrals.
Please watch the first part of the video, focusing on these two key segments: Evaluating an iterated integral: Watch from the beginning to see how to compute a double integral over a rectangular region by integrating with respect to y first, then x. Changing the order of integration: Continue from this point. The presenter re-solves the same problem but reverses the order of integration (dx then dy). Notice that the result is identical.
As the video demonstrates, for a continuous function over a rectangular region, the order of integration does not change the result. This important principle is known as Fubini's Theorem. You can choose whichever order is more convenient to calculate.
Application: Joint Probability Density Functions
Double integrals are the primary tool for working with jointly continuous random variables. Two random variables, X and Y, are jointly continuous if their probabilities can be described by a joint probability density function (PDF), denoted .
Similar to the single-variable case, a joint PDF must satisfy two conditions:
- It is non-negative: for all .
- The total volume under the surface must be 1: .
The following resource introduces this concept and shows how to use a double integral to verify the second property for a joint PDF defined on a rectangular region.
Chapter 5. Multiple Random Variables 5.2: Joint ...
This document provides a formal introduction to joint PDFs and their properties.
Please read the first two pages. Start at the beginning, Deļ¬nition 5.2.1, which formally defines the joint PDF and its properties. Then, carefully study the example that follows, which asks you to find a constant c for a joint PDF. Pay close attention to part (b), where a double integral is set up over a rectangular region [0,1] x [0,1] and solved to ensure the total probability is 1. Also, review part (c), which shows how to calculate a probability over a sub-rectangle.
Double Integrals Over General Regions
Most interesting problems involve integration regions that are not simple rectangles. These are called general regions. We typically describe them in one of two ways.
-
Type I Region (vertically simple): The region is bounded by two functions of on the top and bottom, and by two vertical lines on the sides.
The integral is set up as: -
Type II Region (horizontally simple): The region is bounded by two functions of on the left and right, and by two horizontal lines on the top and bottom.
The integral is set up as:
Notice that the limits of the inner integral are now functions, not constants. The key to setting up these integrals correctly is to first sketch the region of integration.
Calculus III - Double Integrals over General Regions
This resource from Paul's Online Math Notes clearly explains how to set up and evaluate integrals over general regions.
First, read the introductory section to understand the definitions of Type I and Type II regions and see how the iterated integrals are formulated for each. Then, work through Example 1. Part (a) is a straightforward application. Part (b) requires you to first sketch the region bounded by two curves to determine the limits. Part (c) demonstrates a triangular region. Notice how describing it as a Type II region is much more efficient, requiring only one integral instead of two. This highlights the importance of choosing the right order of integration.
To get a better visual intuition for this process, the following video explains the idea of "vertical strips" and "horizontal strips," which correspond to Type I and Type II regions, respectively.
Double Integration Example over General Regions --- two ways!
This video by Dr. Trefor Bazett provides excellent visual intuition for setting up integrals over general regions.
Watch the first part of the video from the beginning. The presenter explains how to find the volume under a surface over a non-rectangular domain by thinking of it as summing up the areas of "vertical strips." This corresponds to setting up a Type I integral (dy dx).
Reversing the Order of Integration
As we saw in the triangular example from Paul's Online Math Notes, sometimes one order of integration is much simpler than the other. In more extreme cases, an integral might be impossible to solve in one order but straightforward in the other. This makes reversing the order of integration a crucial problem-solving skill.
The process always begins with a sketch of the integration region. The image below outlines the general steps.
Let's see this powerful technique in action.
Calculus III - Double Integrals over General Regions
Let's return to Paul's Online Math Notes to see examples where reversing the order is essential.
Read through the text and both parts of Example 2. In part (a), notice that the inner integral is impossible as written. The solution walks through the process: Use the integral limits to define and sketch the region. Re-describe the region for the other integration order (Type II). Set up and solve the new, manageable integral. Follow the same logic for part (b).
Now, let's go back to Dr. Bazett's video. He will solve the same problem as before, but this time using "horizontal strips," effectively reversing the order of integration and showing that both methods yield the same result.
Double Integration Example over General Regions --- two ways!
Let's watch the second half of Dr. Bazett's video.
Watch from this segment, where he resolves the problem using a Type II (dx dy) setup. This provides a great side-by-side comparison of the two approaches. Notice how he has to rearrange the equation y = \sqrt{x} to x = y^2 to get the limits for his inner integral.
Applications to Non-Rectangular Regions in Probability
Finally, let's connect these advanced integration skills back to our goal of studying probability. Many practical problems involve joint PDFs defined over non-rectangular regions. For example, if we are studying two components with lifetimes X and Y, we might be interested in the probability that the first component outlasts the second, i.e., . This corresponds to integrating the joint PDF over a triangular region.
Chapter 5. Multiple Random Variables 5.2: Joint ...
Let's conclude with the examples of joint PDFs on non-rectangular regions from the Stanford course notes.
Read through the two examples on pages 6-9. The first example models a dart throw on a circular target. A circular region is a classic non-rectangular domain. Pay attention to how the limits of integration for the inner integral, \pm\sqrt{R^2 - x^2}, are derived from the equation of the circle. The second example models study time versus exam score over a triangular region defined by y \ge x. Notice how the author sets up the integral for the constant c using both dydx and dxdy orders, demonstrating the flexibility of these methods.
Conclusion
In this lesson, we have added a powerful toolādouble integrationāto our mathematical toolkit. We've moved from single-variable problems to handling two dimensions, a crucial step toward modeling more complex, realistic scenarios in probability.
Here are the key takeaways:
- Double integrals are evaluated as iterated integrals, working from the inside out.
- For non-rectangular regions, the limits of the inner integral are typically functions of the outer variable.
- Sketching the region of integration is the most critical first step in correctly setting up the integral limits.
- Reversing the order of integration is a key technique used to simplify difficult integrals or solve ones that are impossible in their original form.
- Double integrals are the tool used to calculate probabilities from joint probability density functions for two continuous random variables.
In our next lesson, we will conclude this foundational module by exploring a more theoretical topic: the distinction between countable and uncountable sets. This concept is fundamental to understanding the mathematical difference between discrete and continuous probability spaces.