Summation and Product Notation

1. The Language of Sums: Sigma (Σ) Notation

Imagine you want to add the first 100 integers. You could write $1+2+3+\cdots +100$, but this relies on the reader guessing the pattern. Summation notation, which uses the capital Greek letter Sigma (Σ), provides a precise way to express this.

The following video from Khan Academy gives a clear introduction to why this notation is needed and how it works.

As the video explained, the notation has several key parts. Let's break down its anatomy.

Here is a more precise breakdown of the image above:

• Index of Summation (e.g., $n$, $i$, $k$): This is a temporary variable that takes on integer values, one by one. In the image, the index is n.
• Lower Limit (or First Value): The integer where the index starts. In the image, this is 1.
• Upper Limit (or Last Value): The integer where the index ends. In the image, this is n.
• Expression (or "nth term"): The rule or formula that is calculated for each value of the index. The results are then added together. In the image, the expression is simply n.

So, the notation ${\sum }_{n=1}^{5}n$ means:

1. Start with $n=1$. The expression is 1. Current sum is 1.
2. Increment to $n=2$. The expression is 2. Current sum is $1+2$.
3. Increment to $n=3$. The expression is 3. Current sum is $1+2+3$.
4. Increment to $n=4$. The expression is 4. Current sum is $1+2+3+4$.
5. Increment to $n=5$. The expression is 5. Current sum is $1+2+3+4+5$.
6. Stop, because we have reached the upper limit. The final result is 15.

The Connection to Programming

This step-by-step process—initialize, check condition, execute, increment—is exactly how a for loop works in programming. Thinking of summation notation as a "math loop" is a very powerful analogy that will serve you well.

The following article makes this connection explicit with code examples. While you haven't started programming yet, the structure of the examples should feel intuitive based on our breakdown.

2. The Language of Products: Pi (Π) Notation

Just as we have a symbol for repeated addition, we also have one for repeated multiplication. This is product notation, and it uses the capital Greek letter Pi (Π).

The structure is identical to Sigma notation: it has an index, a lower limit, an upper limit, and an expression. The only difference is that you multiply the terms instead of adding them.

The next video gives a quick and clear introduction to Π notation, directly comparing it to the Σ notation we just learned.

For example, to express the product $2\times 3\times 4\times 5$, we could write:

This notation is fundamental to many areas of mathematics, particularly in probability, where the probability of several independent events occurring is the product of their individual probabilities.

As a preview for our next lesson, product notation gives us a formal way to define the factorial of a number $n$, written as $n!$, which is the product of all positive integers up to $n$.

3. Deeper Properties

Since you prefer to understand the underlying principles, let's explore a few formal properties and conventions. These rules help us manipulate and simplify expressions involving summations.

Let's summarize those key points from the reading:

• Linearity: You can pull a constant multiplier out of a summation. For example, ${\sum }_{i=1}^{3}2i=2\times {\sum }_{i=1}^{3}i$. This is just an application of the distributive property: $2(1)+2(2)+2(3)=2(1+2+3)$.
• Splitting Sums: A summation of a sum is the sum of the summations. For instance, ${\sum }_{i=1}^2(i+i^2)={\sum }_{i=1}^{2}i+{\sum }_{i=1}^2{i}^2$.
• Double Sums: A nested sum like ${\sum }_{i=1}^3{\sum }_{j=1}^2(i\cdot j)$ means you loop through the outer index $i$, and for each value of $i$, you loop through all values of the inner index $j$. This is very common in algorithms involving grids or matrices.
• Empty Operations:
  • An empty sum (where the upper limit is less than the lower limit, e.g., ${\sum }_{i=5}^{4}i$) is defined as 0. This is the additive identity—adding it to any number leaves that number unchanged.
  • An empty product (e.g., ${\prod }_{i=5}^{4}i$) is defined as 1. This is the multiplicative identity—multiplying any number by it leaves that number unchanged. These conventions prevent exceptions and errors in mathematical formulas and algorithms.

Conclusion

In this lesson, we demystified two essential mathematical notations that you will see everywhere on your journey into CS and AI. They provide a precise and compact language for expressing repeated addition and multiplication.

Here are our main takeaways:

• Summation Notation (Σ) is used for repeated addition.
• Product Notation (Π) is used for repeated multiplication.
• Both notations are defined by an index, a lower limit, an upper limit, and an expression to be evaluated.
• These notations are the mathematical counterparts to for loops in programming, a concept we will explore in depth soon.
• By convention, an empty sum is 0 (the additive identity) and an empty product is 1 (the multiplicative identity).

This lesson and the next one conclude our first module on mathematical foundations. You are now equipped with the fundamental notation needed to understand more advanced topics. In our next, very brief lesson, we will focus on a special application of product notation: factorials.