Skip to content

Entropy in Quantum Statistical Mechanics

The von Neumann formula

S(ρ)=−kBTr⁡(ρln⁡ρ)S(\rho) = -k_{\mathrm B} \operatorname{Tr} \left( \rho\ln\rho \right)

appears in quantum information, equilibrium statistical mechanics, entanglement theory, and nonequilibrium thermodynamics. The formula is the same, but its physical interpretation is not fixed by the formula alone. One must identify the state, the system boundary, the subsystem partition, the constraints, and any information that has been discarded.

For the Gibbs state of a temperature-independent Hamiltonian, S(ρ)S(\rho) agrees with the entropy derived from its canonical free energy. For the reduced state of part of a globally pure system, it is entanglement entropy. For a generic mixed subsystem, it measures local mixedness and can contain thermal uncertainty, classical correlation, entanglement, and environmental noise. For a deliberately coarse-grained state, it depends on which distinctions were erased.

The examples below compare the full state with a reduced, dephased, or coarse-grained state. For spatial scaling laws and numerical methods, continue to many-body entanglement entropy.

Helpful background. Entropy of a density operator supplies the eigenvalue formula; thermal density operators supply the equilibrium states.

It is useful to separate the dimensionless state entropy

S(ρ)=−Tr⁡(ρln⁡ρ)\mathsf S(\rho) = - \operatorname{Tr} \left( \rho\ln\rho \right)

from the physical entropy

S(ρ)=kBS(ρ).S(\rho) = k_{\mathrm B}\mathsf S(\rho).

With the natural logarithm, S\mathsf S is measured in nats. If S2\mathsf S_2 instead uses log⁡2\log_2, it is measured in bits and S=kBln⁡2 S2S=k_{\mathrm B}\ln2\,\mathsf S_2. Multiplying a bit count by kBk_{\mathrm B} alone misses the factor ln⁡2\ln2.

If

ρ=∑jpj∣j⟩⟨j∣\rho = \sum_j p_j |j\rangle\langle j|

is the spectral decomposition, then

S(ρ)=−∑jpjln⁡pj.\mathsf S(\rho) = - \sum_j p_j\ln p_j.

Thus the von Neumann entropy is the Shannon entropy of the eigenvalue distribution. It is basis independent:

S(UρU†)=S(ρ).\mathsf S(U\rho U^\dagger) = \mathsf S(\rho).

The entropy is a nonlinear functional of the state, not the expectation value of a fixed observable. There is no state-independent Hermitian operator S^\hat S satisfying S(ρ)=Tr⁡(ρS^)S(\rho)=\operatorname{Tr}(\rho\hat S) for all ρ\rho.

When State Entropy Is Thermodynamic Entropy

Section titled “When State Entropy Is Thermodynamic Entropy”

The identification

Sth=S(ρeq)S_{\mathrm{th}} = S(\rho_{\mathrm{eq}})

is justified when ρeq\rho_{\mathrm{eq}} is the equilibrium state associated with the macroscopic constraints and when the resulting entropy obeys the thermodynamic relations appropriate to those controls.

For a regular equilibrium family, this includes relations such as

1T=(∂S∂U)V,N,\frac{1}{T} = \left( \frac{\partial S}{\partial U} \right)_{V,N}, S=−(∂F∂T)V,N,S = - \left( \frac{\partial F}{\partial T} \right)_{V,N},

and

S=−(∂ΩG∂T)V,μ.S = - \left( \frac{\partial\Omega_{\mathrm G}} {\partial T} \right)_{V,\mu}.

The last two derivative formulas assume the microscopic Hamiltonian has no unaccounted explicit temperature dependence. See thermodynamic potentials for these derivative conventions. In particular, the von Neumann entropy of a strongly coupled subsystem generally differs from the thermodynamic entropy derived from its mean-force free energy: its effective Hamiltonian depends on temperature.

The equality between state entropy and thermodynamic entropy is not a claim that every density operator is an equilibrium macrostate. A qubit prepared by a noisy device has a von Neumann entropy, but no temperature, pressure, or entropy density follows without further physical structure.

For ρN,β=e−βHN/ZN\rho_{N,\beta}=e^{-\beta H_N}/Z_N, inserting ln⁡ρ=−βHN−ln⁡ZN\ln\rho=-\beta H_N-\ln Z_N into the entropy definition gives

Sc=kB(ln⁡ZN+βU)=U−FT.S_{\mathrm c}=k_{\mathrm B}(\ln Z_N+\beta U)=\frac{U-F}{T}.

If HNH_N is temperature independent and the necessary moments are finite, this equals −(∂F/∂T)V,N-(\partial F/\partial T)_{V,N}. The exercise below verifies the derivative explicitly. At positive temperature, ∂TS=CV,N/T≥0\partial_T S=C_{V,N}/T\geq0; the canonical ensemble derives the heat-capacity identity.

For the grand-canonical state,

Sgc=kB[ln⁡Ξ+β(U−μN‾)]=U−μN‾−ΩGT.S_{\mathrm{gc}}=k_{\mathrm B}[\ln\Xi+\beta(U-\mu\overline N)] =\frac{U-\mu\overline N-\Omega_{\mathrm G}}{T}.

There is a useful second expression. Because ρ=⨁NP(N)ρN\rho=\bigoplus_N P(N)\rho_N has eigenvalues P(N)pj∣NP(N)p_{j|N},

S(ρ)=−kB∑NP(N)ln⁡P(N)+∑NP(N)S(ρN).S(\rho)=-k_{\mathrm B}\sum_N P(N)\ln P(N) +\sum_N P(N)S(\rho_N).

The first term measures uncertainty about the number sector; the second averages the uncertainty within each sector. Hence an exact grand-canonical entropy is not obtained by substituting the mean number into the canonical entropy. See grand-canonical ensembles for P(N)P(N) and the conditions for local ensemble equivalence.

Let PE,ΔP_{E,\Delta} project onto an energy shell and let

W(E,Δ)=Tr⁡PE,ΔW(E,\Delta) = \operatorname{Tr} P_{E,\Delta}

be its dimension. The microcanonical state is

ρmc=PE,ΔW(E,Δ).\rho_{\mathrm{mc}} = \frac{P_{E,\Delta}}{W(E,\Delta)}.

Its WW nonzero eigenvalues all equal 1/W1/W, so

S(ρmc)=kBln⁡W(E,Δ).S(\rho_{\mathrm{mc}}) = k_{\mathrm B} \ln W(E,\Delta).

This is the shell-count form of Boltzmann entropy. It is exactly equal to the von Neumann entropy of the uniform shell state.

The equality does not assign entropy kBln⁡Wk_{\mathrm B}\ln W to every pure state inside the shell. A pure energy-shell vector obeys

S(∣ψ⟩⟨ψ∣)=0,S \left( |\psi\rangle\langle\psi| \right) = 0,

even when local observables in ∣ψ⟩|\psi\rangle resemble microcanonical predictions. Typicality or the eigenstate thermalization hypothesis can explain agreement for restricted observables; neither changes the global pure-state entropy.

Shell-count, density-of-states, and cumulative-count entropies can differ at finite size. The microcanonical ensemble explains those conventions and the energy-window width.

For a canonical reference state ρβ\rho_\beta, define

FT(ρ)=Tr⁡(ρH^)−TS(ρ).\mathcal F_T(\rho) = \operatorname{Tr}(\rho\hat H) - T S(\rho).

Then

FT(ρ)−Feq=kBTD(ρ∥ρβ),\mathcal F_T(\rho) - F_{\mathrm{eq}} = k_{\mathrm B}T D(\rho\Vert\rho_\beta),

where

D(ρ∥σ)=Tr⁡[ρ(ln⁡ρ−ln⁡σ)].D(\rho\Vert\sigma) = \operatorname{Tr} \left[ \rho \left( \ln\rho- \ln\sigma \right) \right].

At positive TT, nonnegativity of relative entropy gives

FT(ρ)≥Feq.\mathcal F_T(\rho) \geq F_{\mathrm{eq}}.

This identity connects an information-theoretic distinguishability to a thermodynamic free-energy excess. It does not by itself specify how much work a restricted experimental protocol can extract. For the mathematical divergence see relative entropy; for work protocols see quantum thermodynamics. At a normalizable negative temperature, the same identity reverses the inequality.

For a projective measurement with outcomes aa,

pa=Tr⁡(ρPa),p_a = \operatorname{Tr}(\rho P_a),

the outcome entropy is

HM(ρ)=−∑apaln⁡pa.H_{\mathcal M}(\rho) = - \sum_a p_a\ln p_a.

This is the Shannon entropy of one chosen measurement distribution. It depends on the measurement, whereas S(ρ)\mathsf S(\rho) depends only on the state spectrum.

For a rank-one orthonormal projective measurement,

HM(ρ)≥S(ρ),H_{\mathcal M}(\rho) \geq \mathsf S(\rho),

with equality when the measurement diagonalizes ρ\rho, up to degeneracies. A pure state has zero von Neumann entropy but can have a highly uncertain measurement outcome in an incompatible basis.

The rank-one condition matters. A degenerate measurement can have only one certain outcome while the state remains mixed inside its eigenspace; its outcome entropy can then be smaller than the state entropy.

Thus “uncertainty” must be qualified:

  • state entropy describes spectral mixedness;
  • measurement entropy describes uncertainty in a specified outcome distribution;
  • thermodynamic entropy describes an equilibrium state relative to macroscopic controls;
  • entanglement entropy describes a reduced state relative to a subsystem split.

See Shannon entropy for the classical outcome measure.

For an exact product state,

ρAB=ρA⊗ρB,\rho_{AB} = \rho_A\otimes\rho_B,

von Neumann entropy is additive:

S(ρA⊗ρB)=S(ρA)+S(ρB).S(\rho_A\otimes\rho_B) = S(\rho_A) + S(\rho_B).

For a correlated state, subadditivity gives

S(ρAB)≤S(ρA)+S(ρB).S(\rho_{AB}) \leq S(\rho_A) + S(\rho_B).

The difference is the mutual information,

I(A:B)=S(ρA)+S(ρB)−S(ρAB).I(A:B) = S(\rho_A) + S(\rho_B) - S(\rho_{AB}).

Equivalently,

I(A:B)=kBD(ρAB∥ρA⊗ρB)≥0.I(A:B) = k_{\mathrm B} D \left( \rho_{AB} \Vert \rho_A\otimes\rho_B \right) \geq 0.

Thermodynamic extensivity is a scaling property of a family of systems, distinct from the exact additivity identity for a product state. Interacting equilibrium systems generally have correlations across boundaries. For short-range interactions in a regular thermodynamic limit,

SL=sthVL+o(VL),S_L = s_{\mathrm{th}}V_L + o(V_L),

so the leading term is extensive while boundaries and correlations contribute subextensive corrections. Long-range interactions, interfaces, constraints, and criticality can require additional care.

Thermal Entropy Versus Entanglement Entropy

Section titled “Thermal Entropy Versus Entanglement Entropy”

For a pure bipartite state ∣Ψ⟩AB|\Psi\rangle_{AB},

S(ρAB)=0,S(\rho_{AB})=0,

but the reduced states

ρA=Tr⁡B∣Ψ⟩⟨Ψ∣\rho_A = \operatorname{Tr}_B |\Psi\rangle\langle\Psi|

and ρB\rho_B can be mixed. Their common entropy,

S(ρA)=S(ρB),S(\rho_A) = S(\rho_B),

is the bipartite entanglement entropy.

For a mixed thermal state ρAB,β\rho_{AB,\beta}, the subsystem entropy S(ρA)S(\rho_A) is not a general entanglement measure. It can contain:

  • local thermal mixing;
  • entanglement across the cut;
  • classical correlations;
  • correlations with an external environment;
  • boundary and finite-size contributions.

In a homogeneous thermal phase, a sufficiently large region can have

S(ρA)=sth∣A∣+boundary corrections.S(\rho_A) = s_{\mathrm{th}}|A| + \text{boundary corrections}.

The volume term is thermal entropy, not automatically bipartite entanglement.

A globally pure, highly excited many-body eigenstate presents a different case:

S(∣E⟩⟨E∣)=0,S \left( |E\rangle\langle E| \right) = 0,

while a subregion can have volume-law entanglement entropy close to the thermal entropy of that subregion. This is a local statement about ρA\rho_A, not a conversion of the global pure state into a thermal mixture.

For the pure bipartite measure see entanglement entropy; for mixed-state marginals see subsystem entropy. Spatial area and volume laws are developed in many-body entanglement.

Same Local Entropy, Different Global Physics

Section titled “Same Local Entropy, Different Global Physics”

Consider three two-qubit states.

First, the Bell state

∣Φ+⟩=∣00⟩+∣11⟩2|\Phi^+\rangle = \frac{ |00\rangle+|11\rangle }{\sqrt2}

is globally pure. Second, the classically correlated mixture is

ρcc=12∣00⟩⟨00∣+12∣11⟩⟨11∣.\rho_{\mathrm{cc}} = \frac12 |00\rangle\langle00| + \frac12 |11\rangle\langle11|.

Third, the uncorrelated maximally mixed state is

ρprod=IA2⊗IB2.\rho_{\mathrm{prod}} = \frac{\mathbb I_A}{2} \otimes \frac{\mathbb I_B}{2}.

All three have the same one-qubit reduced state:

ρA=ρB=I2,\rho_A = \rho_B = \frac{\mathbb I}{2},

and therefore

SA=SB=kBln⁡2.S_A = S_B = k_{\mathrm B}\ln2.

Their global entropies and mutual informations differ:

State SABS_{AB} I(A:B)I(A:B) Correlation type
Bell state 00 2kBln⁡22k_{\mathrm B}\ln2 pure-state entanglement
classically correlated mixture kBln⁡2k_{\mathrm B}\ln2 kBln⁡2k_{\mathrm B}\ln2 classical correlation
product maximally mixed state 2kBln⁡22k_{\mathrm B}\ln2 00 no AA–BB correlation

The local entropy alone cannot reveal which global state produced it. The state boundary and correlation measure are indispensable.

Fine-Grained Entropy Under Unitary Evolution

Section titled “Fine-Grained Entropy Under Unitary Evolution”

For a closed system,

ρ(t)=U(t)ρ(0)U†(t).\rho(t) = U(t)\rho(0)U^\dagger(t).

Unitary evolution preserves the eigenvalues of ρ\rho, so

S(ρ(t))=S(ρ(0)).S(\rho(t)) = S(\rho(0)).

This exact conservation does not contradict thermodynamic entropy increase. The two statements refer to different descriptions or boundaries.

Entropy can change when one:

  • traces out an environment or complement;
  • discards phase information by dephasing;
  • replaces the exact state by a coarse-grained macrostate;
  • restricts attention to a set of observables;
  • uses an open-system dynamical map;
  • takes a thermodynamic or long-time limit before reversing the dynamics.

None of these operations is the exact unitary evolution of the complete state. Moreover, subsystem von Neumann entropy need not increase monotonically, and not every open-system channel increases entropy. The second law requires an entropy balance that includes reservoirs, correlations, and the allowed operations. See entropy production for those dynamical inequalities.

Let

H^=∑EEPE\hat H = \sum_E E P_E

be the spectral decomposition, including degenerate eigenspaces. Energy dephasing maps

ρ⟼DH(ρ)=∑EPEρPE.\rho \longmapsto \mathcal D_H(\rho) = \sum_E P_E\rho P_E.

This removes coherence between distinct energies while retaining coherence inside degenerate energy subspaces. In finite dimension, DH\mathcal D_H is a unital quantum channel, and

S(DH(ρ))≥S(ρ).S \left( \mathcal D_H(\rho) \right) \geq S(\rho).

For a nondegenerate Hamiltonian, the entropy of the dephased state is the diagonal entropy,

Sd=−kB∑nρnnln⁡ρnn.S_{\mathrm d} = -k_{\mathrm B} \sum_n \rho_{nn} \ln\rho_{nn}.

A pure superposition can have S(ρ)=0S(\rho)=0 and Sd>0S_{\mathrm d}>0. The increase records discarded phase coherence, not a change in the exact global state.

Diagonal entropy can approach thermodynamic entropy for broad classes of large nonintegrable systems and suitable preparations, but that connection has hypotheses. Integrability, degeneracies, conserved charges, and narrow or structured energy distributions can obstruct a simple identification.

Consider a projective coarse-graining C={Pα}\mathcal C=\{P_\alpha\} with

∑αPα=I.\sum_\alpha P_\alpha = \mathbb I.

Define the macrostate probability and Hilbert-space volume by

pα=Tr⁡(Pαρ),Vα=Tr⁡Pα.p_\alpha = \operatorname{Tr} \left( P_\alpha\rho \right), \qquad V_\alpha = \operatorname{Tr} P_\alpha.

The single-coarse-graining observational entropy is

SC(ρ)=−kB∑αpαln⁡(pαVα).S_{\mathcal C}(\rho) = -k_{\mathrm B} \sum_\alpha p_\alpha \ln \left( \frac{p_\alpha}{V_\alpha} \right).

It is the von Neumann entropy of the block-uniform coarse state

ρC=∑αpαVαPα.\rho_{\mathcal C} = \sum_\alpha \frac{p_\alpha}{V_\alpha} P_\alpha.

Therefore, in finite dimension,

S(ρ)≤SC(ρ)≤kBln⁡d,S(\rho) \leq S_{\mathcal C}(\rho) \leq k_{\mathrm B} \ln d,

where dd is the Hilbert-space dimension.

If the state is known only to occupy one macrospace α\alpha, then pα=1p_\alpha=1 and

SC=kBln⁡Vα.S_{\mathcal C} = k_{\mathrm B} \ln V_\alpha.

This recovers the Boltzmann form. A microcanonical shell is one physically important macrospace.

In fact the entropy increase has the exact expression

SC(ρ)−S(ρ)=kBD(ρ∥ρC).S_{\mathcal C}(\rho)-S(\rho) =k_{\mathrm B}D(\rho\Vert\rho_{\mathcal C}).

To see why, ln⁡ρC\ln\rho_{\mathcal C} is constant on each occupied macrospace. Its expectation therefore depends only on the probabilities pαp_\alpha, which the coarse-graining preserves. This proves the lower bound and shows that equality holds exactly when the original state is already block uniform.

The coarse-graining is part of the definition. Position cells, energy windows, local densities, and experimentally resolved observables give different entropies. A coarse-grained entropy is trustworthy only when the retained distinctions match the physical question and resolution.

More elaborate observational entropies can use sequences of noncommuting coarse-grainings. Their ordering and interpretation require additional care; the single projective construction above is the clean benchmark.

Another common coarse-grained entropy keeps only selected expectation values qaq_a and maximizes over all compatible states:

Scg({qa})=sup⁡ρ{S(ρ):Tr⁡(ρQ^a)=qa}.S_{\mathrm{cg}} \left( \{q_a\} \right) = \sup_{\rho} \left\{ S(\rho) : \operatorname{Tr}(\rho\hat Q_a)=q_a \right\}.

The exact state entropy obeys

S(ρ)≤ScgS(\rho) \leq S_{\mathrm{cg}}

whenever ρ\rho satisfies the retained constraints. Equality means that the exact state already is the maximum-entropy representative of those data.

This construction makes the dependence on retained information explicit. Adding constraints can only keep the maximum entropy unchanged or lower it, because the feasible set becomes smaller.

Projective observational entropy, diagonal entropy, maximum-entropy inference, and subsystem entropy are related ways of discarding distinctions, but they are not interchangeable definitions. Each specifies a different information-losing map or optimization.

Entropy Density and the Thermodynamic Limit

Section titled “Entropy Density and the Thermodynamic Limit”

For a sequence of finite systems of volume VLV_L, a thermodynamic entropy density is

s=lim⁡L→∞SLVL,s = \lim_{L\to\infty} \frac{S_L}{V_L},

when the limit exists under specified boundary conditions and fixed intensive variables.

The density can remain finite even when the total entropy diverges with volume. In an infinite system, the total density operator may not be trace class and the total von Neumann entropy may not exist. Local entropies, entropy densities, relative entropies, and differences are often the better-defined objects.

Spatial entanglement entropy in a continuum can also diverge with the ultraviolet cutoff. That divergence is not the same as the extensive thermal divergence with system volume. The regulator, region geometry, and order of limits must be stated.

See the thermodynamic limit for the limiting procedure and boundary assumptions.

For a finite-dimensional system with a unique ground state,

lim⁡T→0+ρβ=∣0⟩⟨0∣,\lim_{T\to0^+} \rho_\beta = |0\rangle\langle0|,

so

lim⁡T→0+S(ρβ)=0.\lim_{T\to0^+} S(\rho_\beta) = 0.

If the exact ground space has degeneracy gg, the finite-system Gibbs limit is the uniform ground-space mixture,

ρ0+=P0g,\rho_{0^+} = \frac{P_0}{g},

and

S(ρ0+)=kBln⁡g.S(\rho_{0^+}) = k_{\mathrm B}\ln g.

An infinitesimal symmetry-breaking field, a superselection sector, or a different order of thermodynamic and zero-temperature limits can select a pure phase instead. Residual entropy statements must therefore specify degeneracy, preparation, sectors, and limit order.

Negative Temperature Does Not Mean Negative Entropy

Section titled “Negative Temperature Does Not Mean Negative Entropy”

For a bounded spectrum, a microcanonical entropy can decrease with energy near the upper spectral edge. Then

1T=(∂S∂U)V,N\frac{1}{T} = \left( \frac{\partial S}{\partial U} \right)_{V,N}

can be negative.

The entropy itself remains nonnegative for a finite-dimensional density operator:

0≤S(ρ)≤kBln⁡d.0 \leq S(\rho) \leq k_{\mathrm B}\ln d.

Negative temperature refers to the slope of the entropy, not to a negative entropy value. Finite-system conclusions can depend on the chosen microcanonical entropy convention, as discussed on the Microcanonical Ensemble page.

In infinite-dimensional Hilbert space, a normalized state can have infinite von Neumann entropy. A canonical partition function can converge while additional moments or entropy limits still require checking. For a Gibbs state, finiteness of both

Z=Tr⁡e−βH^Z = \operatorname{Tr} e^{-\beta\hat H}

and

U=Tr⁡(H^e−βH^)ZU = \frac{ \operatorname{Tr} \left( \hat H e^{-\beta\hat H} \right) }{Z}

is sufficient for the standard expression

S=kB(ln⁡Z+βU)S = k_{\mathrm B} \left( \ln Z+\beta U \right)

to be finite.

In continuum quantum field theory, local algebras need not factor into ordinary tensor products and spatial entanglement entropy is regulator dependent. Finite-dimensional formulas remain useful guides, but they should not be transferred to the continuum without the required algebraic and ultraviolet qualifications.

A qubit is in the pure state ∣0⟩|0\rangle. Compute its von Neumann entropy and the Shannon entropy of measurements in the zz and xx bases.

Solution

The density operator is

ρ=∣0⟩⟨0∣,\rho = |0\rangle\langle0|,

whose eigenvalues are 11 and 00. Therefore

S(ρ)=0.S(\rho)=0.

In the zz basis, the outcomes have probabilities (1,0)(1,0), so

Hz=0.H_z=0.

In the xx basis,

∣0⟩=∣+⟩+∣−⟩2,|0\rangle = \frac{ |+\rangle+|-\rangle }{\sqrt2},

so the outcomes have probabilities (1/2,1/2)(1/2,1/2). Hence

Hx=−2(12ln⁡12)=ln⁡2.H_x = -2 \left( \frac12\ln\frac12 \right) = \ln2.

The state entropy remains zero in both cases. Only the measurement entropy changes.

Starting from

ρβ=e−βH^Z,\rho_\beta = \frac{e^{-\beta\hat H}}{Z},

derive

S=kB(ln⁡Z+βU)S = k_{\mathrm B} \left( \ln Z+\beta U \right)

and show that S=−∂TFS=-\partial_TF for a temperature-independent Hamiltonian.

Solution

Since

ln⁡ρβ=−βH^−ln⁡Z,\ln\rho_\beta = -\beta\hat H- \ln Z,

we have

S=−kBTr⁡(ρβln⁡ρβ)=kB[βTr⁡(ρβH^)+ln⁡Z]=kB(ln⁡Z+βU).\begin{aligned} S &= -k_{\mathrm B} \operatorname{Tr} \left( \rho_\beta\ln\rho_\beta \right) \\ &= k_{\mathrm B} \left[ \beta \operatorname{Tr} \left( \rho_\beta\hat H \right) + \ln Z \right] \\ &= k_{\mathrm B} \left( \ln Z+\beta U \right). \end{aligned}

Now

F=−kBTln⁡Z.F = -k_{\mathrm B}T\ln Z.

For temperature-independent H^\hat H,

∂ln⁡Z∂T=UkBT2.\frac{\partial\ln Z}{\partial T} = \frac{U}{k_{\mathrm B}T^2}.

Therefore

−∂F∂T=kBln⁡Z+kBT∂ln⁡Z∂T=kBln⁡Z+UT=S.\begin{aligned} - \frac{\partial F}{\partial T} &= k_{\mathrm B}\ln Z + k_{\mathrm B}T \frac{\partial\ln Z}{\partial T} \\ &= k_{\mathrm B}\ln Z + \frac{U}{T} \\ &= S. \end{aligned}

Let a four-dimensional Hilbert space have basis {∣1⟩,∣2⟩,∣3⟩,∣4⟩}\{|1\rangle,|2\rangle,|3\rangle,|4\rangle\}. The exact state is ∣1⟩|1\rangle. A coarse-graining has two macrospaces,

PA=∣1⟩⟨1∣+∣2⟩⟨2∣,P_A = |1\rangle\langle1| + |2\rangle\langle2|,

and

PB=∣3⟩⟨3∣+∣4⟩⟨4∣.P_B = |3\rangle\langle3| + |4\rangle\langle4|.

Compute the observational entropy. Then refine PAP_A into one-dimensional projectors and compute it again.

Solution

For the coarse partition,

pA=1,pB=0,p_A=1, \qquad p_B=0,

and

VA=VB=2.V_A=V_B=2.

Thus

SC=−kBln⁡(12)=kBln⁡2.S_{\mathcal C} = -k_{\mathrm B} \ln \left( \frac12 \right) = k_{\mathrm B}\ln2.

The observer knows only that the state lies in a two-dimensional macrospace.

After refining PAP_A into ∣1⟩⟨1∣|1\rangle\langle1| and ∣2⟩⟨2∣|2\rangle\langle2|, the occupied macrospace has volume one. Hence

SC′=0.S_{\mathcal C'}=0.

The exact state has zero von Neumann entropy throughout. The coarse entropy changes because the retained resolution changes.

Dephasing is not uniform mixing within a degenerate block

Section titled “Dephasing is not uniform mixing within a degenerate block”

In a three-dimensional space let H=Δ∣3⟩⟨3∣H=\Delta\lvert3\rangle\langle3\rvert and ∣ψ⟩=(∣1⟩+∣2⟩)/2\lvert\psi\rangle=(\lvert1\rangle+\lvert2\rangle)/\sqrt2. Compare the energy-measurement outcome entropy, the entropy after energy dephasing, and the projective coarse-grained entropy for P0=∣1⟩⟨1∣+∣2⟩⟨2∣P_0=\lvert1\rangle\langle1\rvert+\lvert2\rangle\langle2\rvert and PΔ=∣3⟩⟨3∣P_\Delta=\lvert3\rangle\langle3\rvert.

Solution

The energy is certainly zero, so the outcome entropy is zero. Energy dephasing leaves the pure state unchanged because both components lie in the same degenerate energy block; its state entropy is also zero. The block-uniform coarse state is instead P0/2P_0/2 and has entropy kBln⁡2k_{\mathrm B}\ln2. Resolving an energy value, erasing coherences between different energies, and forgetting all distinctions within an energy block are three different operations.