Recommended resources
The freely available resources this lesson will direct you to.
- Von Neumann Entropy in Quantum Mechanics versus Shannon Entropy in Classical Information Theorywww.youtube.com
- Statistical mechanics and quantum entanglementwww.youtube.com
- Lecture 11, Tues Feb 21: Quantifying Entanglement, Mixed ...www.scottaaronson.com
- Statistical Mechanics Lecture set 5: Density Matrix Abstractspot.colorado.edu
Hello! Welcome to the next lesson in our module on Open Quantum Systems and Measurement.
In our last session, we mastered the partial trace, a crucial tool for isolating and describing a subsystem when it's part of a larger quantum system . We made a critical observation: even if the total system is in a pure state, its subsystem is generally in a mixed state if the two are entangled. The "mixedness" of the subsystem's reduced density matrix, , is a direct fingerprint of this entanglement.
Today, we will build directly on that foundation to achieve our learning outcome: to quantify entanglement using purity and von Neumann entropy. We'll move beyond a simple yes/no answer to "is it entangled?" and learn how to answer "by how much?". These measures are not just abstract concepts; they are essential tools in modern condensed matter physics for characterizing quantum phases of matter, understanding thermalization in isolated systems, and quantifying resources in quantum computation.
1. Purity: A First Look at Entanglement
We've already encountered the purity, , as a simple test for whether a state is pure or mixed. Let's formalize its role as a measure of entanglement. When we have a bipartite system in a pure state, the purity of the reduced density matrix tells us about the entanglement between and .
- If and are not entangled (i.e., the total state is a product state), then is pure, and its purity is .
- If and are entangled, is mixed, and its purity is . The more entangled the state, the more mixed becomes, and the lower its purity.
- For a subsystem with a -dimensional Hilbert space, the minimum possible purity is , corresponding to a maximally mixed state, which arises from maximal entanglement with another system.
Purity is useful for a quick check, but it lacks some of the deeper properties and interpretations of a true information-theoretic measure. For that, we need to introduce a more powerful concept.
2. The Von Neumann Entropy
The proper quantum mechanical analogue of classical Shannon entropy is the von Neumann entropy. For a system described by a density matrix , it is defined as:
This definition might seem abstract, but it becomes much clearer when we consider the eigenvalues of the density matrix. Since is Hermitian, it can be diagonalized. Let its eigenvalues be . In the basis where is diagonal, the operator is also diagonal with elements . The calculation of the trace then simplifies dramatically:
This looks exactly like the Shannon entropy for a classical probability distribution given by the eigenvalues .

The von Neumann entropy has several key properties that make it a robust measure of the "mixedness" or uncertainty in a quantum state:
- Non-negativity: .
- Pure States: if and only if is a pure state. In this case, one eigenvalue is 1 and all others are 0, so . There is no uncertainty.
- Maximally Mixed States: The entropy is maximum for a maximally mixed state, where . In this case, all eigenvalues are , and the entropy is . There is maximum uncertainty.
To see a clear, pedagogical breakdown of these properties, please watch the following video.
Von Neumann Entropy in Quantum Mechanics versus Shannon Entropy in Classical Information Theory
The video 'Von Neumann Entropy...' provides an excellent explanation of the entropy formula, its calculation via eigenvalues, and its key properties. It also explicitly contrasts it with purity.
Watch from 06:52 to 17:50. This segment defines the von Neumann entropy, explains how to calculate it, and discusses its bounds for pure and maximally mixed states, comparing it directly to the purity measure.
3. Entanglement Entropy: Quantifying Quantum Connection
Now we can combine the concepts from the last two lessons. We have a way to describe a subsystem () and a way to quantify its mixedness (). This leads us to the central definition of this lesson.
For a bipartite system in a pure state , the entanglement entropy is defined as the von Neumann entropy of the reduced density matrix of either subsystem.
Crucially, it can be proven that for a pure state of the composite system, the entropy of both subsystems is identical: . Entanglement is a shared property.
The entanglement entropy directly quantifies the amount of entanglement between and .
- If , the subsystems are not entangled.
- If , the subsystems are entangled. The larger the value, the greater the entanglement.
This concept is so fundamental that it bridges quantum mechanics with statistical mechanics and information theory. The following reading from Leo Radzihovsky's lecture notes formalizes this idea and provides clear examples.
Statistical Mechanics Lecture set 5: Density Matrix
These lecture notes on the density matrix, from a statistical mechanics perspective, provide a concise and physically motivated definition of entanglement entropy.
Read section VI.B, titled 'Entanglement entropy in closed quantum systems'. It starts on page 17. This section defines entanglement entropy via the reduced density matrix and gives the examples of an unentangled product state and an entangled singlet state.
The key insight is that the entropy of a subsystem doesn't come from classical ignorance about its state, but from purely quantum correlations with another system. All the information is encoded in the non-local correlations, making the local state appear random.
4. Calculating Entanglement Entropy
Let's make this concrete. Consider the state we analyzed in the previous lesson's exercise:
We found the reduced density matrix for subsystem A to be:
The eigenvalues are simply and . The entanglement entropy is therefore:
Let's check the limits:
- Product state (e.g., ): . No entanglement.
- Maximally entangled Bell state (): . This is the maximum entropy for a single qubit and corresponds to one "ebit" (entangled bit) of entanglement.
The Schmidt Decomposition
Calculating eigenvalues for large matrices can be difficult. Fortunately, for bipartite pure states, there is a powerful mathematical tool called the Schmidt decomposition. It states that any pure state can be written in the special form:
where and are orthonormal sets of states for their respective subsystems, and the are non-negative real numbers called Schmidt coefficients, satisfying . The number of non-zero coefficients, , is the Schmidt rank.
The magic of this decomposition is that the squared Schmidt coefficients, , are precisely the non-zero eigenvalues of the reduced density matrices and . This gives us a direct way to compute the entanglement entropy:
A state is entangled if and only if its Schmidt rank .
The following notes provide a clear explanation of Schmidt decomposition and its connection to entanglement entropy.
Lecture 11: Quantifying Entanglement
These excellent lecture notes by Scott Aaronson from a quantum computing course explain how to use the Schmidt decomposition as the primary tool for quantifying entanglement in bipartite pure states.
Read the first three sections, from the start of the document up to the heading 'A sample calculation...'. This covers the Schmidt Decomposition, the definition of von Neumann entropy, and finally the definition and calculation of Entanglement Entropy.
Test your understanding!
Consider the following two-qubit state:
This state is already in Schmidt form.
- What are the Schmidt coefficients?
- What are the eigenvalues of the reduced density matrix ?
- Calculate the purity .
- Calculate the entanglement entropy . Is the state more or less entangled than a Bell state?
Show answer
-
The Schmidt coefficients are and .
-
The eigenvalues of are the squares of the Schmidt coefficients: and . The reduced density matrix is .
-
The purity is .
Since , the state is entangled. For a Bell state, the purity would be . Since , we can guess that this state is less entangled. -
The entanglement entropy is:
Numerically, .
For a Bell state, the entropy is . Since , this state is indeed less entangled than a maximally entangled Bell state.
Conclusion
In this lesson, we have developed the primary tools for quantifying quantum entanglement in bipartite systems.
Key Takeaways:
- For a pure bipartite state, the "mixedness" of a subsystem's reduced density matrix is a direct measure of its entanglement with the other part.
- Purity, , is a simple indicator of mixedness, where means pure (no entanglement) and means mixed (entangled).
- Von Neumann Entropy, , is the definitive measure of mixedness and uncertainty in a quantum state.
- Entanglement Entropy, , is the von Neumann entropy of a subsystem's reduced density matrix. For a pure bipartite state, it quantifies the entanglement, ranging from 0 for a product state to for a maximally entangled state in dimensions.
- The Schmidt decomposition is a powerful technique that simplifies the calculation of entanglement entropy by directly providing the eigenvalues of the reduced density matrices.
Preview of the Next Lesson:
So far, we have focused on a static picture: describing a subsystem and quantifying its entanglement at a single point in time. In the next lesson, we will turn to dynamics. We will begin to model how an open quantum system evolves under the influence of its environment, leading to phenomena like decoherence and dissipation, using the powerful Lindblad master equation.