Entropy in Quantum Statistical Mechanics
The von Neumann formula
appears in quantum information, equilibrium statistical mechanics, entanglement theory, and nonequilibrium thermodynamics. The formula is the same, but its physical interpretation is not fixed by the formula alone. One must identify the state, the system boundary, the subsystem partition, the constraints, and any information that has been discarded.
For the Gibbs state of a temperature-independent Hamiltonian, agrees with the entropy derived from its canonical free energy. For the reduced state of part of a globally pure system, it is entanglement entropy. For a generic mixed subsystem, it measures local mixedness and can contain thermal uncertainty, classical correlation, entanglement, and environmental noise. For a deliberately coarse-grained state, it depends on which distinctions were erased.
The examples below compare the full state with a reduced, dephased, or coarse-grained state. For spatial scaling laws and numerical methods, continue to many-body entanglement entropy.
Helpful background. Entropy of a density operator supplies the eigenvalue formula; thermal density operators supply the equilibrium states.
Entropy of the state spectrum
Section titled “Entropy of the state spectrum”It is useful to separate the dimensionless state entropy
from the physical entropy
With the natural logarithm, is measured in nats. If instead uses , it is measured in bits and . Multiplying a bit count by alone misses the factor .
If
is the spectral decomposition, then
Thus the von Neumann entropy is the Shannon entropy of the eigenvalue distribution. It is basis independent:
The entropy is a nonlinear functional of the state, not the expectation value of a fixed observable. There is no state-independent Hermitian operator satisfying for all .
When State Entropy Is Thermodynamic Entropy
Section titled “When State Entropy Is Thermodynamic Entropy”The identification
is justified when is the equilibrium state associated with the macroscopic constraints and when the resulting entropy obeys the thermodynamic relations appropriate to those controls.
For a regular equilibrium family, this includes relations such as
and
The last two derivative formulas assume the microscopic Hamiltonian has no unaccounted explicit temperature dependence. See thermodynamic potentials for these derivative conventions. In particular, the von Neumann entropy of a strongly coupled subsystem generally differs from the thermodynamic entropy derived from its mean-force free energy: its effective Hamiltonian depends on temperature.
The equality between state entropy and thermodynamic entropy is not a claim that every density operator is an equilibrium macrostate. A qubit prepared by a noisy device has a von Neumann entropy, but no temperature, pressure, or entropy density follows without further physical structure.
Canonical thermal entropy
Section titled “Canonical thermal entropy”For , inserting into the entropy definition gives
If is temperature independent and the necessary moments are finite, this equals . The exercise below verifies the derivative explicitly. At positive temperature, ; the canonical ensemble derives the heat-capacity identity.
Entropy across particle-number sectors
Section titled “Entropy across particle-number sectors”For the grand-canonical state,
There is a useful second expression. Because has eigenvalues ,
The first term measures uncertainty about the number sector; the second averages the uncertainty within each sector. Hence an exact grand-canonical entropy is not obtained by substituting the mean number into the canonical entropy. See grand-canonical ensembles for and the conditions for local ensemble equivalence.
Microcanonical Entropy
Section titled “Microcanonical Entropy”Let project onto an energy shell and let
be its dimension. The microcanonical state is
Its nonzero eigenvalues all equal , so
This is the shell-count form of Boltzmann entropy. It is exactly equal to the von Neumann entropy of the uniform shell state.
The equality does not assign entropy to every pure state inside the shell. A pure energy-shell vector obeys
even when local observables in resemble microcanonical predictions. Typicality or the eigenstate thermalization hypothesis can explain agreement for restricted observables; neither changes the global pure-state entropy.
Shell-count, density-of-states, and cumulative-count entropies can differ at finite size. The microcanonical ensemble explains those conventions and the energy-window width.
Free Energy and Relative Entropy
Section titled “Free Energy and Relative Entropy”For a canonical reference state , define
Then
where
At positive , nonnegativity of relative entropy gives
This identity connects an information-theoretic distinguishability to a thermodynamic free-energy excess. It does not by itself specify how much work a restricted experimental protocol can extract. For the mathematical divergence see relative entropy; for work protocols see quantum thermodynamics. At a normalizable negative temperature, the same identity reverses the inequality.
State Entropy Versus Measurement Entropy
Section titled “State Entropy Versus Measurement Entropy”For a projective measurement with outcomes ,
the outcome entropy is
This is the Shannon entropy of one chosen measurement distribution. It depends on the measurement, whereas depends only on the state spectrum.
For a rank-one orthonormal projective measurement,
with equality when the measurement diagonalizes , up to degeneracies. A pure state has zero von Neumann entropy but can have a highly uncertain measurement outcome in an incompatible basis.
The rank-one condition matters. A degenerate measurement can have only one certain outcome while the state remains mixed inside its eigenspace; its outcome entropy can then be smaller than the state entropy.
Thus “uncertainty” must be qualified:
- state entropy describes spectral mixedness;
- measurement entropy describes uncertainty in a specified outcome distribution;
- thermodynamic entropy describes an equilibrium state relative to macroscopic controls;
- entanglement entropy describes a reduced state relative to a subsystem split.
See Shannon entropy for the classical outcome measure.
Additivity, Correlations, and Extensivity
Section titled “Additivity, Correlations, and Extensivity”For an exact product state,
von Neumann entropy is additive:
For a correlated state, subadditivity gives
The difference is the mutual information,
Equivalently,
Thermodynamic extensivity is a scaling property of a family of systems, distinct from the exact additivity identity for a product state. Interacting equilibrium systems generally have correlations across boundaries. For short-range interactions in a regular thermodynamic limit,
so the leading term is extensive while boundaries and correlations contribute subextensive corrections. Long-range interactions, interfaces, constraints, and criticality can require additional care.
Thermal Entropy Versus Entanglement Entropy
Section titled “Thermal Entropy Versus Entanglement Entropy”For a pure bipartite state ,
but the reduced states
and can be mixed. Their common entropy,
is the bipartite entanglement entropy.
For a mixed thermal state , the subsystem entropy is not a general entanglement measure. It can contain:
- local thermal mixing;
- entanglement across the cut;
- classical correlations;
- correlations with an external environment;
- boundary and finite-size contributions.
In a homogeneous thermal phase, a sufficiently large region can have
The volume term is thermal entropy, not automatically bipartite entanglement.
A globally pure, highly excited many-body eigenstate presents a different case:
while a subregion can have volume-law entanglement entropy close to the thermal entropy of that subregion. This is a local statement about , not a conversion of the global pure state into a thermal mixture.
For the pure bipartite measure see entanglement entropy; for mixed-state marginals see subsystem entropy. Spatial area and volume laws are developed in many-body entanglement.
Same Local Entropy, Different Global Physics
Section titled “Same Local Entropy, Different Global Physics”Consider three two-qubit states.
First, the Bell state
is globally pure. Second, the classically correlated mixture is
Third, the uncorrelated maximally mixed state is
All three have the same one-qubit reduced state:
and therefore
Their global entropies and mutual informations differ:
| State | Correlation type | ||
|---|---|---|---|
| Bell state | pure-state entanglement | ||
| classically correlated mixture | classical correlation | ||
| product maximally mixed state | no – correlation |
The local entropy alone cannot reveal which global state produced it. The state boundary and correlation measure are indispensable.
Fine-Grained Entropy Under Unitary Evolution
Section titled “Fine-Grained Entropy Under Unitary Evolution”For a closed system,
Unitary evolution preserves the eigenvalues of , so
This exact conservation does not contradict thermodynamic entropy increase. The two statements refer to different descriptions or boundaries.
Entropy can change when one:
- traces out an environment or complement;
- discards phase information by dephasing;
- replaces the exact state by a coarse-grained macrostate;
- restricts attention to a set of observables;
- uses an open-system dynamical map;
- takes a thermodynamic or long-time limit before reversing the dynamics.
None of these operations is the exact unitary evolution of the complete state. Moreover, subsystem von Neumann entropy need not increase monotonically, and not every open-system channel increases entropy. The second law requires an entropy balance that includes reservoirs, correlations, and the allowed operations. See entropy production for those dynamical inequalities.
Dephasing and Diagonal Entropy
Section titled “Dephasing and Diagonal Entropy”Let
be the spectral decomposition, including degenerate eigenspaces. Energy dephasing maps
This removes coherence between distinct energies while retaining coherence inside degenerate energy subspaces. In finite dimension, is a unital quantum channel, and
For a nondegenerate Hamiltonian, the entropy of the dephased state is the diagonal entropy,
A pure superposition can have and . The increase records discarded phase coherence, not a change in the exact global state.
Diagonal entropy can approach thermodynamic entropy for broad classes of large nonintegrable systems and suitable preparations, but that connection has hypotheses. Integrability, degeneracies, conserved charges, and narrow or structured energy distributions can obstruct a simple identification.
Projective Coarse-Grained Entropy
Section titled “Projective Coarse-Grained Entropy”Consider a projective coarse-graining with
Define the macrostate probability and Hilbert-space volume by
The single-coarse-graining observational entropy is
It is the von Neumann entropy of the block-uniform coarse state
Therefore, in finite dimension,
where is the Hilbert-space dimension.
If the state is known only to occupy one macrospace , then and
This recovers the Boltzmann form. A microcanonical shell is one physically important macrospace.
In fact the entropy increase has the exact expression
To see why, is constant on each occupied macrospace. Its expectation therefore depends only on the probabilities , which the coarse-graining preserves. This proves the lower bound and shows that equality holds exactly when the original state is already block uniform.
The coarse-graining is part of the definition. Position cells, energy windows, local densities, and experimentally resolved observables give different entropies. A coarse-grained entropy is trustworthy only when the retained distinctions match the physical question and resolution.
More elaborate observational entropies can use sequences of noncommuting coarse-grainings. Their ordering and interpretation require additional care; the single projective construction above is the clean benchmark.
Constraint-Based Coarse Graining
Section titled “Constraint-Based Coarse Graining”Another common coarse-grained entropy keeps only selected expectation values and maximizes over all compatible states:
The exact state entropy obeys
whenever satisfies the retained constraints. Equality means that the exact state already is the maximum-entropy representative of those data.
This construction makes the dependence on retained information explicit. Adding constraints can only keep the maximum entropy unchanged or lower it, because the feasible set becomes smaller.
Projective observational entropy, diagonal entropy, maximum-entropy inference, and subsystem entropy are related ways of discarding distinctions, but they are not interchangeable definitions. Each specifies a different information-losing map or optimization.
Entropy Density and the Thermodynamic Limit
Section titled “Entropy Density and the Thermodynamic Limit”For a sequence of finite systems of volume , a thermodynamic entropy density is
when the limit exists under specified boundary conditions and fixed intensive variables.
The density can remain finite even when the total entropy diverges with volume. In an infinite system, the total density operator may not be trace class and the total von Neumann entropy may not exist. Local entropies, entropy densities, relative entropies, and differences are often the better-defined objects.
Spatial entanglement entropy in a continuum can also diverge with the ultraviolet cutoff. That divergence is not the same as the extensive thermal divergence with system volume. The regulator, region geometry, and order of limits must be stated.
See the thermodynamic limit for the limiting procedure and boundary assumptions.
Zero Temperature and Residual Entropy
Section titled “Zero Temperature and Residual Entropy”For a finite-dimensional system with a unique ground state,
so
If the exact ground space has degeneracy , the finite-system Gibbs limit is the uniform ground-space mixture,
and
An infinitesimal symmetry-breaking field, a superselection sector, or a different order of thermodynamic and zero-temperature limits can select a pure phase instead. Residual entropy statements must therefore specify degeneracy, preparation, sectors, and limit order.
Negative Temperature Does Not Mean Negative Entropy
Section titled “Negative Temperature Does Not Mean Negative Entropy”For a bounded spectrum, a microcanonical entropy can decrease with energy near the upper spectral edge. Then
can be negative.
The entropy itself remains nonnegative for a finite-dimensional density operator:
Negative temperature refers to the slope of the entropy, not to a negative entropy value. Finite-system conclusions can depend on the chosen microcanonical entropy convention, as discussed on the Microcanonical Ensemble page.
Infinite-Dimensional Caveats
Section titled “Infinite-Dimensional Caveats”In infinite-dimensional Hilbert space, a normalized state can have infinite von Neumann entropy. A canonical partition function can converge while additional moments or entropy limits still require checking. For a Gibbs state, finiteness of both
and
is sufficient for the standard expression
to be finite.
In continuum quantum field theory, local algebras need not factor into ordinary tensor products and spatial entanglement entropy is regulator dependent. Finite-dimensional formulas remain useful guides, but they should not be transferred to the continuum without the required algebraic and ultraviolet qualifications.
Exercises
Section titled “Exercises”State entropy and measurement entropy
Section titled “State entropy and measurement entropy”A qubit is in the pure state . Compute its von Neumann entropy and the Shannon entropy of measurements in the and bases.
Solution
The density operator is
whose eigenvalues are and . Therefore
In the basis, the outcomes have probabilities , so
In the basis,
so the outcomes have probabilities . Hence
The state entropy remains zero in both cases. Only the measurement entropy changes.
Canonical entropy identity
Section titled “Canonical entropy identity”Starting from
derive
and show that for a temperature-independent Hamiltonian.
Solution
Since
we have
Now
For temperature-independent ,
Therefore
Resolution dependence of coarse entropy
Section titled “Resolution dependence of coarse entropy”Let a four-dimensional Hilbert space have basis . The exact state is . A coarse-graining has two macrospaces,
and
Compute the observational entropy. Then refine into one-dimensional projectors and compute it again.
Solution
For the coarse partition,
and
Thus
The observer knows only that the state lies in a two-dimensional macrospace.
After refining into and , the occupied macrospace has volume one. Hence
The exact state has zero von Neumann entropy throughout. The coarse entropy changes because the retained resolution changes.
Dephasing is not uniform mixing within a degenerate block
Section titled “Dephasing is not uniform mixing within a degenerate block”In a three-dimensional space let and . Compare the energy-measurement outcome entropy, the entropy after energy dephasing, and the projective coarse-grained entropy for and .
Solution
The energy is certainly zero, so the outcome entropy is zero. Energy dephasing leaves the pure state unchanged because both components lie in the same degenerate energy block; its state entropy is also zero. The block-uniform coarse state is instead and has entropy . Resolving an energy value, erasing coherences between different energies, and forgetting all distinctions within an energy block are three different operations.
References
Section titled “References”- H. B. Callen, Thermodynamics and an Introduction to Thermostatistics, 2nd ed., Wiley (1985), chapters 1–7 and 15.
- S. Goldstein, J. L. Lebowitz, R. Tumulka, and N. Zanghì, “Canonical Typicality”, Physical Review Letters 96, 050403 (2006).
- E. T. Jaynes, “Information Theory and Statistical Mechanics”, Physical Review 106, 620–630 (1957).
- M. A. Nielsen and I. L. Chuang, Quantum Computation and Quantum Information, 10th anniversary ed., Cambridge University Press (2010), chapters 11 and 12.
- R. K. Pathria and P. D. Beale, Statistical Mechanics, 4th ed., Elsevier (2021), chapters 2–5.
- A. Polkovnikov, “Microscopic Diagonal Entropy and Its Connection to Basic Thermodynamic Relations”, Annals of Physics 326, 486–499 (2011).
- S. Popescu, A. J. Short, and A. Winter, “Entanglement and the Foundations of Statistical Mechanics”, Nature Physics 2, 754–758 (2006).
- J. von Neumann, Mathematical Foundations of Quantum Mechanics, Princeton University Press (1955), chapter V.
- A. Wehrl, “General Properties of Entropy”, Reviews of Modern Physics 50, 221–260 (1978).
- D. Šafránek, J. M. Deutsch, and A. Aguirre, “Quantum Coarse-Grained Entropy and Thermodynamics”, Physical Review A 99, 010101(R) (2019).