Variational Many-Body States
A variational many-body state is a restricted, parameterized family of wavefunctions chosen to represent the correlations, symmetries, signs, and entanglement expected in an interacting system. The state family is the physical hypothesis. Optimization decides which member of that family is best for a specified Hamiltonian.
For a nonzero trial state , the variational energy is
If is self-adjoint and bounded below and the trial state lies in its quadratic-form domain, then
This inequality is powerful but limited. It certifies an exactly evaluated energy, not the fidelity of every observable, the correctness of an inferred phase, the success of a stochastic optimizer, or the efficiency of representing the state.
The central question is therefore not merely “How many parameters does the ansatz have?” It is:
Which physical structures are easy, hard, or impossible for this state family to express and evaluate?
Helpful background. The variational principle supplies the upper bound, and many-particle wavefunctions supply exchange symmetry.
The Variational Statement in a Many-Body Space
Section titled “The Variational Statement in a Many-Body Space”Expand a normalized trial state in exact energy eigenstates:
where
Then
The energy weights errors by excitation energy. A small admixture of a very high-energy state can matter strongly, while substantial rearrangement inside a nearly degenerate low-energy manifold can change observables with little energy penalty.
Sector-resolved upper bounds
Section titled “Sector-resolved upper bounds”If
and the trial state lies entirely in a fixed sector, its energy bounds the lowest energy in that sector. This is often the meaningful statement for fixed:
- particle number;
- total momentum;
- parity;
- total spin or a spin component;
- point-group representation;
- topological or gauge-constraint sector.
A trial state in the wrong sector may have a low energy while being irrelevant to the target state.
Stationarity is a projected equation
Section titled “Stationarity is a projected equation”For a real parameter ,
At a stationary point with respect to these real parameters,
for every retained tangent direction. The residual need not vanish in the full Hilbert space. It is orthogonal in the real inner product . Complex orthogonality follows only when the tangent space also contains times each direction. For example, a real state varied within real amplitudes has identically zero expectation of , although can be nonzero and imaginary.
Energy variance
Section titled “Energy variance”For a normalized state, define
Equivalently,
Zero variance means that the state is an exact eigenstate. It does not by itself identify which eigenstate, so energy, symmetry sector, and overlap diagnostics still matter.
Taxonomy at a Glance
Section titled “Taxonomy at a Glance”| State family | Structure built in | Main strength | Characteristic limitation |
|---|---|---|---|
| product state | local amplitudes | simple order parameters and limits | no intersite entanglement |
| Slater determinant | fermionic antisymmetry and exchange | efficient Gaussian observables | one idempotent one-body projector |
| determinant expansion | linear superposition of references | systematic in a fixed orbital basis | combinatorial determinant count |
| Jastrow-correlated state | explicit symmetric correlations | cusps and correlation holes | positive factor leaves fermion nodes fixed |
| BCS or Pfaffian state | pair structure | pairing and anomalous correlations | Gaussian or pair-product bias |
| Gutzwiller-projected state | local occupancy suppression | constrained correlated fermions | hard expectation values and restricted reference bias |
| matrix product state | bounded virtual-bond structure | controlled one-dimensional entanglement | bond dimension grows for difficult cuts |
| neural quantum state | learned amplitude and phase map | flexible nonlocal dependence | nonconvex training and weak a priori control |
No row is uniformly “more expressive” in the operational sense. Expressivity depends on the parameter scaling, symmetry sector, target accuracy, observable, and cost allowed for evaluation and optimization.
Product and Mean-Field References
Section titled “Product and Mean-Field References”For a lattice with local basis , a site-product state is
Such a state can represent:
- classical ordered patterns;
- coherent local moments;
- site-dependent density profiles;
- broken-symmetry mean fields;
- exact product limits of interacting models.
Across every spatial cut,
Product states can display nonzero order parameters, but a pure site-product state has factorized cross-site correlators. Classical mixing can add classical correlations, and projection can turn the reference into a different, correlated state family. Their simplicity makes product states valuable reference points, not generic descriptions of correlated phases.
The phrase Gutzwiller ansatz is used in two different ways:
-
In the Bose–Hubbard literature, a single-site Gutzwiller state is often the product state
-
In correlated-fermion work, a Gutzwiller wavefunction usually means a determinant or paired state acted on by a local occupancy projector.
These are not the same ansatz. Bose–Hubbard Model derives the site-product mean field. The fermionic projector is developed below.
Slater Determinants
Section titled “Slater Determinants”For fermions in orthonormal spin-orbitals, with complete one-particle coordinates , a normalized determinant state is
The determinant:
- enforces antisymmetry exactly;
- vanishes when two identical fermions occupy the same spin-orbital;
- represents a fermionic Gaussian state with fixed particle number;
- permits efficient evaluation of many observables through Wick factorization.
For orthonormal occupied orbitals, its one-body density operator is
and therefore
The idempotency condition is a structural restriction. An interacting state can have fractional natural-orbital occupations even at zero temperature and cannot then be represented by one determinant.
What a determinant includes
Section titled “What a determinant includes”A determinant is not an uncorrelated classical distribution. It contains:
- exact exchange antisymmetry;
- an exchange hole for identical fermions;
- orbital delocalization;
- entanglement associated with a chosen mode or spatial partition.
What it omits is correlation beyond a single Gaussian fixed-number state. Hartree–Fock Approximation optimizes this manifold and derives its direct and exchange fields.
Nodal structure
Section titled “Nodal structure”For a real determinant,
defines its nodes in configuration space. These nodes determine the sign sectors of the wavefunction. Multiplying by a strictly positive scalar factor changes amplitudes inside nodal cells but not the cells themselves.
This distinction matters in fermionic variational and fixed-node Monte Carlo: excellent amplitude correlation cannot repair an incorrect nodal surface unless the ansatz also changes the determinant, uses multiple determinants, backflow, pairing, or another sign-changing structure.
Determinant Expansions
Section titled “Determinant Expansions”A linear multi-determinant state is
For fixed orbitals and a chosen determinant set , optimizing the coefficients is a Rayleigh–Ritz problem. Enlarging cannot increase the exact variational minimum.
Determinant expansions can represent:
- near-degenerate configurations;
- bond breaking and static correlation;
- symmetry-adapted combinations;
- systematic full-configuration-interaction limits in a finite orbital basis.
Their cost grows combinatorially. Truncation by excitation rank, selected configurations, active spaces, or tensor factorization introduces a second modeling choice beyond the one-particle basis.
The phrase “systematic” always needs a qualifier: systematic in which orbital basis, determinant hierarchy, symmetry sector, and extrapolation protocol?
Jastrow Correlators
Section titled “Jastrow Correlators”A Slater–Jastrow state has the form
where denotes the full configuration and is symmetric under exchange of identical particles. A cluster expansion may be written
The two-body term can directly encode:
- short-range avoidance;
- interaction cusps;
- screening correlations;
- long-wavelength density fluctuations;
- species- or spin-dependent pair structure.
Three-body and higher functions can encode joint angular and environmental dependence that a sum of independent pair terms misses.
Exchange symmetry
Section titled “Exchange symmetry”If is symmetric, then
for an exchange . Therefore a symmetric Jastrow factor preserves the bosonic or fermionic exchange character of the reference state.
Nodes and phases
Section titled “Nodes and phases”If is real and finite, then
Consequently,
A positive Jastrow factor does not change fermion nodes. For finite complex , is also nonzero, so the zeros still coincide, although the phase changes. Singular limits or additional factors that vanish can change the nodal set.
Lattice density Jastrow factor
Section titled “Lattice density Jastrow factor”For lattice occupations, one common form is
In a translationally invariant system,
up to the stated Fourier and background conventions.
Short-ranged controls local density correlations. Singular small- behavior can encode long-range collective suppression. The optimized kernel is state- and Hamiltonian-dependent; calling every density Jastrow “screening” is too vague.
Cusp conditions
Section titled “Cusp conditions”For singular interactions, finiteness of the local energy can impose an exact short-distance derivative condition on the wavefunction. A Jastrow factor can build that cusp into the ansatz rather than forcing a large smooth basis to approximate it.
The precise coefficient depends on:
- the interaction normalization;
- reduced mass;
- particle charges or coupling;
- spatial dimension;
- relative angular momentum and spin channel.
The relevant cusp condition should be derived for the Hamiltonian at hand rather than imported by memory.
Evaluation
Section titled “Evaluation”Jastrow factors make normalization and expectation values genuinely many-body integrals. Cluster expansions work in controlled regimes; otherwise stochastic evaluation is common. Variational Monte Carlo Preview develops the estimator and uncertainty analysis.
Backflow and Nodal Improvement
Section titled “Backflow and Nodal Improvement”A backflow state evaluates a determinant at collective coordinates,
For a translationally invariant continuum example,
Each effective coordinate depends on the surrounding particles. Unlike a positive Jastrow multiplier, backflow generally changes the nodal surface because the determinant zeros are evaluated at rather than .
Backflow illustrates a general design lesson:
- multiplicative positive correlators improve amplitudes inside sign sectors;
- coordinate transformations and reference superpositions can alter the sign structure itself.
BCS and Pair-Product States
Section titled “BCS and Pair-Product States”An unprojected spin-singlet BCS state can be written
It is a fermionic Gaussian state in Nambu space. It builds coherent pair structure into the reference but mixes even particle-number sectors.
BCS Mean-Field Theory derives the self-consistent saddle, gap equation, quasiparticles, thermodynamics, and symmetry caveats. Here the important variational fact is that pairing changes the state manifold beyond number-conserving determinants.
Fixed-number pair state
Section titled “Fixed-number pair state”For even , a number-conserving pair-product state can be written schematically as
with
In a coordinate basis, a general antisymmetric pairing amplitude produces a Pfaffian. For restricted opposite-spin pairing, the amplitude can reduce to a determinant of pair orbitals.
Pair states can express:
- Cooper pairing;
- resonating valence-bond structure after projection;
- spin-triplet or singlet channels;
- richer nodes than a single occupied-orbital determinant.
They remain biased toward pair structure and do not automatically capture every multiparticle correlation.
Particle-number projection
Section titled “Particle-number projection”Number projection uses
Then
has exact particle number provided the projected vector is nonzero. An even-parity BCS product has no odd-number component; it needs a blocked unpaired orbital for odd . Projection changes expectation values and should not be treated as a cosmetic relabeling of the unprojected saddle.
Symmetry Projection
Section titled “Symmetry Projection”For a finite group , a projector onto irreducible representation is
where is the representation dimension and its character. For a unitary representation this projects onto the full isotypic subspace: all copies of , not one chosen vector or one copy when multiplicities occur.
For compact groups, replace the normalized sum by a normalized Haar integral. Noncompact groups need a separate spectral construction. Projection can restore:
- particle number;
- total momentum;
- point-group quantum numbers;
- parity;
- angular momentum;
- spin quantum numbers.
Projection is especially useful when a simple reference breaks a symmetry whose finite-system eigenstates should preserve it.
Projection after variation and variation after projection
Section titled “Projection after variation and variation after projection”Two procedures differ:
- Projection after variation: optimize the broken-symmetry reference and project afterward.
- Variation after projection: evaluate and minimize the projected energy from the start.
The second explores a different energy landscape and is variationally at least as flexible within the projected family, but it is usually more expensive.
If a projector does not commute with another correlator or truncation, the order of operations must be stated.
Fermionic Gutzwiller Projection
Section titled “Fermionic Gutzwiller Projection”For the single-band Hubbard local space, define
A partial Gutzwiller correlator is
Every doubly occupied site contributes one factor of . Thus:
while
The Gutzwiller wavefunction is
where may be a determinant, density-wave reference, or paired state.
For , is a correlator but not an idempotent projector:
The word “projection” is exact only at the hard endpoints or for an explicitly idempotent constrained-space operator.
What hard projection enforces
Section titled “What hard projection enforces”At ,
for every site. At fixed particle number , this also forces one particle per site. Below half filling, empty sites remain allowed. Above , hard projection annihilates the entire state.
The t–J Model Preview derives the no-double-occupancy effective Hamiltonian. A projected variational state respects its local Hilbert space, but that alone does not prove that the chosen reference captures the phase.
Projected BCS and RVB states
Section titled “Projected BCS and RVB states”A common fixed-number projected pair state is
At half filling it can be interpreted as a superposition of singlet coverings determined by the pair amplitude. Away from half filling it includes mobile holes in the projected space.
The projection introduces strong non-Gaussian correlations. Wick’s theorem for the unprojected BCS state no longer evaluates projected observables directly.
Worked Example: Hubbard Dimer
Section titled “Worked Example: Hubbard Dimer”Consider two sites, two fermions, and
In the even spin-singlet sector, define the covalent and symmetric ionic states
and
With a consistent phase convention,
in the ordered basis .
The noninteracting bonding determinant is
Applying the partial Gutzwiller factor gives
Its energy is
For and , stationarity gives
so the physical root is
The optimized energy is
which is the exact dimer ground-state energy.
This exactness is special: the ground state for has a positive ionic-to-covalent ratio within . This interval contains the required eigenvector; it does not span every complex vector in the sector. The example nevertheless gives three general lessons:
-
At , and the determinant is exact.
-
At large ,
so doublons are suppressed but remain virtually important.
-
Hard projection gives zero energy for this two-site state and misses the finite- superexchange lowering
A strict low-energy effective Hamiltonian must retain that virtual process through an exchange term even after doublons are removed from its state space.
The same family connects the bonding determinant at to the no-doublon state at . For , its optimum is and . Hard projection discards the virtual doublon amplitude and misses this energy lowering.
Matrix Product States Preview
Section titled “Matrix Product States Preview”For an open chain with local basis , a matrix product state is
The matrix
has dimensions
The are bond dimensions. For approximately uniform local dimension and bond dimension , the raw parameter count scales as
rather than .
Entanglement capacity
Section titled “Entanglement capacity”Across bond , the Schmidt rank is at most . Therefore
This makes MPS especially natural for one-dimensional ground states with limited entanglement. It also identifies the failure mode: an exact generic volume-law state requires exponentially large .
The entropy bound is necessary, not sufficient. Accuracy also depends on:
- the decay of the Schmidt spectrum;
- the ordering of degrees of freedom along the chain;
- long-range interactions;
- boundary conditions;
- target observables;
- whether the state is critical, highly excited, or time evolved.
Gauge redundancy
Section titled “Gauge redundancy”On an internal bond, the transformation
and
leaves the physical coefficients unchanged for invertible .
The tensors are therefore not unique coordinates on state space. Canonical forms organize this gauge freedom and make Schmidt data explicit; their full construction belongs on the dedicated Matrix Product States page.
Exactness and efficiency are different
Section titled “Exactness and efficiency are different”Every finite-chain state admits an exact MPS if is allowed to grow sufficiently. In the worst case,
Thus “MPS can represent every state” is not an efficiency theorem. The useful statement is that physically important one-dimensional states often admit controlled approximation at much smaller bond dimension.
Neural Quantum States Preview
Section titled “Neural Quantum States Preview”A neural quantum state uses a parameterized function to assign a complex amplitude to each basis configuration:
Here:
- controls the log magnitude;
- controls the phase;
- may denote spins, occupations, particle coordinates, or another complete configuration.
This logarithmic form is schematic. An exact zero of the amplitude requires a separate vanishing factor or the limiting behavior .
The architecture is part of the ansatz. Restricted Boltzmann machines, feed-forward networks, convolutional networks, autoregressive models, graph networks, and attention-based models impose different connectivity, symmetry, sampling, and evaluation costs.
Restricted Boltzmann example
Section titled “Restricted Boltzmann example”For visible spins and binary hidden variables summed analytically, a common restricted Boltzmann amplitude is
With real , , and , this expression is positive in the displayed basis. It cannot represent a sign-changing wavefunction. Complex parameters, a separate phase network, a sign-carrying reference state, or another architecture is required.
What neural parameterization can offer
Section titled “What neural parameterization can offer”Neural states can encode:
- nonlocal correlations without a fixed geometric tensor network;
- parameter sharing from translation or graph structure;
- separate amplitude and phase models;
- autoregressive conditional amplitudes;
- continuum antisymmetry when combined with determinants or equivariant constructions.
What it does not guarantee
Section titled “What it does not guarantee”A universal approximation statement may require exponentially many parameters or inaccessible optimization. It does not guarantee:
- efficient training;
- efficient sampling;
- the correct symmetry or sign sector;
- stable local energies;
- accurate observables away from the optimized loss;
- a controlled error as architecture size grows;
- reliable extrapolation in system size.
Neural quantum states are variational ansätze, not a separate variational theorem. Their claims require the same energy, variance, symmetry, finite-size, sampling, and benchmark comparisons as traditional states.
Hybrid Ansätze
Section titled “Hybrid Ansätze”Useful state families are often composites:
Another possibility is
where is a symmetric neural correction and carries antisymmetry.
Different factors can perform complementary tasks:
| Factor | Intended role |
|---|---|
| determinant or Pfaffian | exchange sign and reference nodes |
| Jastrow factor | short- and long-range amplitude correlations |
| backflow | environment-dependent nodal deformation |
| symmetry projector | exact quantum numbers |
| Gutzwiller factor | local occupancy suppression |
| MPS or neural factor | residual structured correlations |
The decomposition is not unique. Redundant factors can create ill-conditioned directions, and noncommuting operators make ordering physically relevant.
Optimization Error Is Not Ansatz Error
Section titled “Optimization Error Is Not Ansatz Error”Let
be the exact minimum inside ansatz family . A reported value can be decomposed schematically as
The terms represent:
- ansatz error from restricting the state family;
- optimization error from not finding its minimum;
- estimation error from finite sampling or approximate contraction.
Only the first two are nonnegative for exact expectation values. A noisy estimate can fall below by chance.
Nonconvex landscapes
Section titled “Nonconvex landscapes”Jastrow kernels, projected states, MPS tensors, and neural parameters usually define nonlinear manifolds. Optimization can encounter:
- local minima;
- saddle points;
- symmetry-related solutions;
- gauge directions;
- singular metrics;
- vanishing or noisy gradients;
- phase competition and hysteresis.
Comparing distinct initial states helps reveal competing minima and optimizer dependence.
Size Consistency and Extensivity
Section titled “Size Consistency and Extensivity”Suppose two subsystems do not interact:
If the ansatz can represent
then
This proves additivity for that product trial state. To conclude that the optimized family is size consistent, one must also show that its joint minimum equals the sum of the separate minima. Merely including product states proves only ; a larger joint family may access fragment reduced states absent from the separately optimized families. The model spaces and optimization constraints must factor consistently.
Size consistency can fail when:
- a determinant truncation does not factorize;
- a global correlator retains artificial cross-subsystem terms;
- a projection couples otherwise independent fragments;
- parameter sharing forces inequivalent regions to use the same amplitudes;
- an architecture or normalization changes with total size.
Energy extensivity,
is related but distinct. Both properties should be checked explicitly.
Exercises
Section titled “Exercises”MPS entanglement requirement
Section titled “MPS entanglement requirement”An open-chain MPS has bond dimension across a cut. Prove that
What scaling of is required by a volume law across the middle of a chain?
Solution
The MPS bond index gives a Schmidt decomposition with at most nonzero Schmidt probabilities. Entropy is maximized when those probabilities are uniform:
Therefore
If
then exact representation requires
The required bond dimension is exponential in system size.
Sign structure of a real RBM
Section titled “Sign structure of a real RBM”Consider
with all parameters real. Can it represent a basis-dependent wavefunction with both positive and negative amplitudes?
Solution
For real arguments,
and
Every factor is therefore positive, so
for every configuration. The displayed real-parameter RBM cannot represent sign changes in that basis. One may use complex parameters, a separate phase model, or multiply by a sign-carrying reference state.
Zero variance is not enough
Section titled “Zero variance is not enough”Construct a normalized state with zero energy variance that is not the ground state. What additional information identifies the target?
Solution
Any exact excited eigenstate works. If
then
so
To identify the ground state one also needs the lowest energy in the relevant symmetry sector or an independent lower bound. For a targeted excited state, one needs its quantum numbers, orthogonality conditions, spectral ordering, or overlap with a known target subspace.
Real and complex tangent directions
Section titled “Real and complex tangent directions”Take and with real . Find the energy, its derivative and the overlap . Is stationarity an eigenvalue equation?
Solution
for all , so . Yet , giving the overlap . Its real part vanishes, as required by real-parameter stationarity; the full residual has norm one. The exact eigenstates need complex relative phases absent from this family.
References
Section titled “References”- P. W. Anderson, “The Resonating Valence Bond State in La2CuO4 and Superconductivity,” Science 235, 1196–1198 (1987), doi:10.1126/science.235.4793.1196.
- J. Bardeen, L. N. Cooper, and J. R. Schrieffer, “Theory of Superconductivity,” Physical Review 108, 1175–1204 (1957), doi:10.1103/PhysRev.108.1175.
- G. Carleo and M. Troyer, “Solving the Quantum Many-Body Problem with Artificial Neural Networks,” Science 355, 602–606 (2017), doi:10.1126/science.aag2302.
- G. Carleo, I. Cirac, K. Cranmer, L. Daudet, M. Schuld, N. Tishby, L. Vogt-Maranto, and L. Zdeborová, “Machine Learning and the Physical Sciences,” Reviews of Modern Physics 91, 045002 (2019), doi:10.1103/RevModPhys.91.045002.
- M. Fannes, B. Nachtergaele, and R. F. Werner, “Finitely Correlated States on Quantum Spin Chains,” Communications in Mathematical Physics 144, 443–490 (1992), doi:10.1007/BF02099178.
- W. M. C. Foulkes, L. Mitas, R. J. Needs, and G. Rajagopal, “Quantum Monte Carlo Simulations of Solids,” Reviews of Modern Physics 73, 33–83 (2001), doi:10.1103/RevModPhys.73.33.
- M. C. Gutzwiller, “Effect of Correlation on the Ferromagnetism of Transition Metals,” Physical Review Letters 10, 159–162 (1963), doi:10.1103/PhysRevLett.10.159.
- M. C. Gutzwiller, “Effect of Correlation on the Ferromagnetism of Transition Metals,” Physical Review 134, A923–A941 (1964), doi:10.1103/PhysRev.134.A923.
- R. Jastrow, “Many-Body Problem with Strong Forces,” Physical Review 98, 1479–1484 (1955), doi:10.1103/PhysRev.98.1479.
- S. Östlund and S. Rommer, “Thermodynamic Limit of Density Matrix Renormalization,” Physical Review Letters 75, 3537–3540 (1995), doi:10.1103/PhysRevLett.75.3537.
- U. Schollwöck, “The Density-Matrix Renormalization Group in the Age of Matrix Product States,” Annals of Physics 326, 96–192 (2011), doi:10.1016/j.aop.2010.09.012.
- J. C. Slater, “The Theory of Complex Spectra,” Physical Review 34, 1293–1322 (1929), doi:10.1103/PhysRev.34.1293.
- S. Sorella, “Wave Function Optimization in the Variational Monte Carlo Method,” Physical Review B 71, 241103(R) (2005), doi:10.1103/PhysRevB.71.241103.
- F. Verstraete, V. Murg, and J. I. Cirac, “Matrix Product States, Projected Entangled Pair States, and Variational Renormalization Group Methods for Quantum Spin Systems,” Advances in Physics 57, 143–224 (2008), doi:10.1080/14789940801912366.