Summation and Product Notation

Welcome to your first lesson in the Probability course! To build a solid understanding of probability, we first need to establish a firm grasp of the mathematical language used to describe its concepts. This initial module, "Mathematical Foundations for Probability," will equip you with the essential tools you'll need throughout your studies.

In this lesson, we will focus on a fundamental concept: how to represent and work with sums and products of many numbers in a compact and powerful way. You will learn to use summation (Sigma) and product (Pi) notation, which are indispensable in probability for defining concepts like expected value, variance, and various probability distributions. By the end of this lesson, you will be able to apply this notation to express and evaluate mathematical series.

Let's begin by looking at the two main symbols for today's lesson.

The capital Greek letters Sigma (Σ) and Pi (Π) are used in mathematics to represent summation and multiplication, respectively.

Summation Notation: The Sigma (Σ)

Imagine you need to add a long list of numbers, like the first 100 integers. Writing 1 + 2 + 3 + ... + 100 is cumbersome and can be ambiguous. Mathematicians use a more precise and compact method called summation notation, using the capital Greek letter Sigma, Σ.

This notation neatly packages three key pieces of information:

What to sum (the expression for each term).
Where to start the sum (the starting value of an index).
Where to end the sum (the ending value of the index).

Let's break down its structure:

k = 1 \sum n a_{k} = a_{1} + a_{2} + \dots + a_{n}

$\sum$ is the sigma symbol, telling us to sum.
$k$ is the index of summation (sometimes $i$ or $j$ is used). It's a temporary variable that takes on integer values.
$k = 1$ is the lower limit, indicating the starting value for the index $k$ .
$n$ is the upper limit, indicating the final value for the index $k$ .
$a_{k}$ is the expression for the terms to be added. For each value of $k$ from 1 to $n$ , we calculate $a_{k}$ and add it to the running total.

The following webpage provides a clear, gentle introduction to this concept.

Sigma and Pi Notation (Summation and Product Notation) – MathMaine

This article from MathMaine offers a friendly overview of summation notation.

Please read the section Sigma (Summation) Notation. Pay close attention to the examples that show how the index variable is used to generate the terms of the sum.

For a more formal definition and to see how this concept relates to computer programming logic, which often uses loops to perform similar repeated operations, watch the first part of this short video.

Summation and Product Notation in 3 Minutes | Mathematical Notation

This video from 3-Minute Data Science provides a quick, animated summary of summation notation.

Watch from the beginning until the end of the summation example. The video's analogy to a for loop in programming is a helpful way to think about the step-by-step process of summation.

Properties of Summation

To work effectively with summations, we can use several properties that allow us to manipulate and simplify them. These properties are direct consequences of the standard rules of arithmetic (like the distributive and associative properties).

The most important properties for our purposes are:

Factoring out a constant: A constant factor within a sum can be moved outside the summation sign. $k = 1 \sum n c \cdot a_{k} = c \cdot k = 1 \sum n a_{k}$
Splitting a sum: A summation of an expression with multiple terms can be split into separate summations for each term. $k = 1 \sum n (a_{k} + b_{k}) = k = 1 \sum n a_{k} + k = 1 \sum n b_{k}$

These properties are incredibly useful because they allow us to break down complex sums into simpler, more manageable parts. The following resource provides a formal list of these properties.

[PDF] Summation and Product Notation

This PDF chapter gives a rigorous overview of summation properties.

Read the section titled Properties of Σ for finite summations. Focus on understanding properties (10.1) and (10.3), which correspond to the splitting and constant factor rules mentioned above. The other properties are also useful, but these two are the most fundamental for simplification.

Evaluating Common Series

While writing out short sums is easy, evaluating a sum with hundreds of terms is impractical. Fortunately, there are closed-form formulas for several common types of series. Knowing these will be very valuable later in the course for calculating quantities like the expected value of a random variable.

Here are the three most essential formulas:

Sum of a constant $c$ : $k = 1 \sum n c = n c$
Sum of the first $n$ integers: $k = 1 \sum n k = \frac{n ( n + 1 )}{2}$
Sum of the first $n$ squares: $k = 1 \sum n k^{2} = \frac{n ( n + 1 ) ( 2 n + 1 )}{6}$

Professor Leonard provides an excellent video walkthrough of these formulas and how to apply them.

Introduction to Series and Summation Notation (Precalculus - College Algebra 68)

Professor Leonard's lecture on Series and Summation Notation.

First, watch the segment that introduces these formulas: Formulas for series. Then, watch the detailed example where he uses the properties and formulas together to evaluate a complex sum: Solving a complex series. This will show you the step-by-step process of breaking down a problem and applying the appropriate tools.

Handling Sums That Don't Start at 1

What if a sum doesn't start at $k = 1$ ? The formulas we've learned assume it does. The trick is to express the sum you want as the difference of two sums that both start at 1.

For example, to find $\sum_{k = 4}^{10} a_{k}$ , you can calculate the sum from 1 to 10 and then subtract the part you don't want—the sum from 1 to 3.

k = 4 \sum 10 a_{k} = (k = 1 \sum 10 a_{k}) - (k = 1 \sum 3 a_{k})

Professor Leonard explains this technique clearly.

Introduction to Series and Summation Notation (Precalculus - College Algebra 68)

Professor Leonard's lecture on Series and Summation Notation.

Watch this short segment explaining the strategy: When you don't start at one.

Product Notation: The Pi (Π)

Just as Sigma notation provides a shorthand for addition, product notation provides a shorthand for multiplication. It uses the capital Greek letter Pi, Π. The structure and rules are analogous to summation notation.

k = 1 \prod n a_{k} = a_{1} \times a_{2} \times \dots \times a_{n}

A classic example of product notation is the factorial function, which you will encounter in combinatorial probability. The factorial of a non-negative integer $n$ , denoted $n!$ , is the product of all positive integers up to $n$ .

n! = 1 \times 2 \times 3 \times \dots \times n = k = 1 \prod n k

By definition, $0! = 1$ . This makes sense in the context of product notation: a product over an empty set of terms (an "empty product") is defined to be the multiplicative identity, which is 1.

For a formal introduction to Pi notation and its properties, you can refer back to our resources.

[PDF] Summation and Product Notation

This PDF covers product notation after its discussion of summation.

Read the two short sections introducing Pi notation. Start at the heading The notation for products and continue through the end of the next section, "Properties of Π for finite products." Notice the strong parallels with the properties of summation.

Let's Practice

Now, let's apply what you've learned.

Problem 1: Expressing a sum
Write the following sum using summation notation:
$3 - 5 + 7 - 9 + 11 - 13$

Hint: Notice two patterns here. The numbers themselves are increasing odd numbers, and the sign is alternating. Try to find an expression for the $k$ -th term that captures both patterns.

Solution

The terms are $3, - 5, 7, - 9, 11, - 13$ . There are 6 terms.
The absolute values are $3, 5, 7, 9, 11, 13$ . The $k$ -th term in this sequence can be represented as $2 k + 1$ (starting with $k = 1$ ).
The signs are $+, -, +, -, +, -$ . This pattern can be represented by $(- 1)^{k + 1}$ or $(- 1)^{k - 1}$ .
Combining these, we get the expression for the $k$ -th term: $(- 1)^{k + 1} (2 k + 1)$ .
Since there are 6 terms, the summation is:

k = 1 \sum 6 (- 1)^{k + 1} (2 k + 1)

Problem 2: Evaluating a sum
Evaluate the following summation using the properties and formulas you've learned:

k = 1 \sum 20 (k^{2} - 3 k + 4)

Solution

First, we use the properties of summation to split the expression into three simpler sums:

k = 1 \sum 20 k^{2} - k = 1 \sum 20 3 k + k = 1 \sum 20 4

Next, we factor out the constant from the second term:

k = 1 \sum 20 k^{2} - 3 k = 1 \sum 20 k + k = 1 \sum 20 4

Now we apply the formulas with $n = 20$ :

For $\sum k^{2}$ : $\frac{n ( n + 1 ) ( 2 n + 1 )}{6} = \frac{20 ( 21 ) ( 41 )}{6} = 2870$
For $\sum k$ : $\frac{n ( n + 1 )}{2} = \frac{20 ( 21 )}{2} = 210$
For $\sum 4$ : $n c = 20 \times 4 = 80$

Finally, we combine these results:

2870 - 3 (210) + 80 = 2870 - 630 + 80 = 2320

Conclusion

In this lesson, you've been introduced to two powerful notational tools: summation (Σ) and product (Π). You have learned how to read expressions written in this notation, how to translate a series of terms into this compact form, and how to use properties and standard formulas to efficiently evaluate complex sums.

Mastering this notation is the first step on our journey. It provides the language we will use to define and analyze the core concepts of probability.

In our next lesson, we will continue to build our mathematical toolkit by reviewing key results from single-variable calculus, specifically differentiation and integration. These concepts will be crucial for working with continuous probability distributions later in the course.

Recommended resources