Optimization and Mean Value Theorems

1. Finding the Peaks and Valleys: Maxima and Minima

In many engineering and scientific problems, we want to find the "best" value—the maximum efficiency, minimum cost, or strongest signal. In mathematical terms, this is a search for a function's extrema (its maximum or minimum values).

Local vs. Global Extrema

It's important to distinguish between two types of extrema:

• Local (or Relative) Maximum/Minimum: A point that is the highest or lowest in its immediate neighborhood. A function can have several local maxima or minima.
• Global (or Absolute) Maximum/Minimum: The single highest or lowest value the function takes over its entire domain or a specified interval.

The following video provides a clear graphical distinction between these concepts.

The First Derivative: Identifying Critical Points

How do we find these high and low points mathematically? In the last lesson, you learned that the derivative, $f^{\prime }(x)$, gives the slope of the tangent line. At a smooth peak or valley, the tangent line is horizontal, meaning its slope is zero. This is our starting point.

A stationary point of a function $f(x)$ is a point $x=c$ where $f^{\prime }(c)=0$. These points are our primary candidates for local maxima or minima.

The sign of the first derivative tells us whether the function is increasing or decreasing:

• If $f^{\prime }(x)>0$ on an interval, $f(x)$ is increasing on that interval.
• If $f^{\prime }(x)<0$ on an interval, $f(x)$ is decreasing on that interval.

This leads to the First Derivative Test: at a stationary point $x=c$:

1. If $f^{\prime }(x)$ changes from positive to negative, the function goes from increasing to decreasing. This indicates a local maximum.
2. If $f^{\prime }(x)$ changes from negative to positive, the function goes from decreasing to increasing. This indicates a local minimum.
3. If $f^{\prime }(x)$ does not change sign, it is neither a local max nor min. This is often a point of inflection.

This next segment from the video explains this relationship in detail.

The Second Derivative Test: A More Direct Approach

While the first derivative test is reliable, checking sign changes can be tedious. The Second Derivative Test is often quicker. The second derivative, $f^{\prime \prime }(x)$, tells us about the function's concavity.

• If $f^{\prime \prime }(x)<0$, the graph is concave down (like an upside-down 'U'), suggesting a maximum.
• If $f^{\prime \prime }(x)>0$, the graph is concave up (like a 'U'), suggesting a minimum.

The Test: For a stationary point $c$ where $f^{\prime }(c)=0$:

1. If $f^{\prime \prime }(c)<0$, then $f$ has a local maximum at $c$.
2. If $f^{\prime \prime }(c)>0$, then $f$ has a local minimum at $c$.
3. If $f^{\prime \prime }(c)=0$, the test is inconclusive. The point could be a local maximum, a local minimum, or a point of inflection. In this case, you must either revert to the First Derivative Test or examine higher-order derivatives.

Let's see how this test works and what to do when it's inconclusive.

Finding Global Extrema in a Closed Interval

GATE questions often ask for the absolute maximum or minimum value of a function $f(x)$ on a closed interval $[a,b]$. The global extremum can occur either at a local extremum inside the interval or at the interval's endpoints.

Here is a foolproof procedure:

1. Find all stationary points of $f(x)$ by solving $f^{\prime }(x)=0$.
2. Consider only the stationary points that lie within the interval $(a,b)$.
3. Make a list of candidate values: evaluate $f(x)$ at these stationary points and also at the endpoints, $f(a)$ and $f(b)$.
4. The largest value in your list is the global maximum, and the smallest is the global minimum.

Let's watch a complete problem that brings these ideas together.

2. The Mean Value Theorems

The Mean Value Theorems are "existence" theorems. They don't tell you how to find a value, but they guarantee that a value with certain properties exists. They form the theoretical backbone for many results in calculus.

Rolle's Theorem

Imagine driving a car from a starting point and returning to the exact same elevation later. If your path was smooth (differentiable), at some point during your trip, you must have been driving on perfectly flat ground (your instantaneous vertical speed was zero).

This is the essence of Rolle's Theorem.

Conditions: A function $f(x)$ must be:

1. Continuous on the closed interval $[a,b]$.
2. Differentiable on the open interval $(a,b)$.
3. $f(a)=f(b)$ (starts and ends at the same height).

Conclusion: There exists at least one number $c$ in $(a,b)$ such that $f^{\prime }(c)=0$.

Lagrange's Mean Value Theorem (MVT)

Rolle's Theorem is a special case of the more general Lagrange's Mean Value Theorem. The MVT drops the condition that $f(a)=f(b)$.

The MVT states that for a smooth curve, there is at least one point where the instantaneous rate of change (the slope of the tangent line) is equal to the average rate of change over the entire interval (the slope of the secant line connecting the endpoints).

Using the car analogy: if your average speed on a 4-hour, 100 km trip was 25 km/h, then at some instant, your speedometer must have read exactly 25 km/h.

Conditions: A function $f(x)$ must be:

1. Continuous on the closed interval $[a,b]$.
2. Differentiable on the open interval $(a,b)$.

Conclusion: There exists at least one number $c$ in $(a,b)$ such that:

This theorem is surprisingly useful for setting bounds on function values, a common pattern in GATE questions.

Conclusion

In this lesson, we have moved from the theory of derivatives to their practical application in optimization and analysis. You've learned systematic methods for finding and classifying the extreme values of functions, a fundamental skill in engineering.

Key Takeaways:

• Local Extrema are found at stationary points where $f^{\prime }(x)=0$, and can be classified using the First or Second Derivative Tests.
• If $f^{\prime \prime }(c)=0$, the second derivative test is inconclusive, and the point might be a point of inflection.
• To find the Global Extrema on a closed interval $[a,b]$, you must compare the function's values at all stationary points inside the interval and at the endpoints $a$ and $b$.
• Rolle's Theorem guarantees a point with a zero derivative ($f^{\prime }(c)=0$) if the function starts and ends at the same value.
• Lagrange's Mean Value Theorem generalizes this, guaranteeing a point where the instantaneous rate of change equals the average rate of change over the interval.

Having explored the power of derivatives, our next lesson will turn to the other side of the calculus coin: Integration. We will learn how to reverse the process of differentiation to find areas, accumulate quantities, and solve a whole new class of problems.