Lanczos Method Preview
The Lanczos method replaces a prohibitively large Hermitian eigenproblem by a sequence of Hamiltonian-vector products and a small tridiagonal projection. In many-body work, this makes it possible to approximate a ground state or a few extremal states inside one symmetry sector without storing or diagonalizing the full dense Hamiltonian. A second Lanczos run, seeded by an operator acting on the ground state, can also represent a zero-temperature spectral function as a continued fraction.
Lanczos is powerful because it asks only for the action
not every entry of a dense matrix. A small residual tests the finite eigenproblem, while the start vector determines which spectral components are accessible. Both facts are central to using the result correctly.
Required background. Finite diagonalization defines the represented problem; sparse eigensolvers introduces iterative matrix methods.
Krylov subspaces and spectral support
Section titled “Krylov subspaces and spectral support”Starting from , define the order- Krylov subspace
Every vector in this subspace has the form
where is a polynomial of degree at most . This polynomial viewpoint explains both the strength and the blind spots of the method.
Expand the seed in exact eigenvectors of the chosen sector:
Then
The polynomial can amplify wanted spectral components and suppress unwanted ones. It cannot create a component that the seed lacks. If
then is absent from the entire Krylov sequence in exact arithmetic.
This fact has two immediate many-body consequences.
- A seed in the wrong exact symmetry sector can never reach the desired state.
- A specially chosen seed may miss an eigenstate even within the correct sector because of an additional selection rule or accidental orthogonality.
A generic random vector within a declared sector has nonzero overlap with every fixed eigenvector with probability one for a continuous random distribution and a fixed eigenbasis in exact arithmetic. That statement does not remove the need to record the random seed or to test more than one start vector when near-degeneracies and very small overlaps matter.
Scalar shifts do not add information
Section titled “Scalar shifts do not add information”For any scalar ,
The equality follows from the binomial expansion in both directions. Shifting the energy origin can improve numerical scaling or make formulas convenient, but it does not enlarge the exact Krylov subspace. Targeting interior eigenvalues generally requires more than replacing by ; Sparse Eigensolvers discusses spectral transformations and other solver choices.
The Hermitian Three-Term Projection
Section titled “The Hermitian Three-Term Projection”For a Hermitian , orthogonal projection produces an orthonormal basis
and a real symmetric tridiagonal matrix
With and , one exact-arithmetic step may be written
The coefficients form
The compact projection identity is
where is the last coordinate vector in . The entire large-space calculation is compressed into repeated applications of , the vectors needed by the chosen storage policy, and the small tridiagonal matrix .
An exact zero is called breakdown. It is benign when it means that has become an invariant subspace: the accessible spectral information has closed exactly. A tiny in floating-point arithmetic requires more care because roundoff, near-invariance, and loss of orthogonality can be difficult to distinguish.
Ritz Ground-State Approximation
Section titled “Ritz Ground-State Approximation”Diagonalize the small matrix:
The corresponding Ritz vector in the many-body space is
Its Rayleigh quotient is exactly the Ritz value:
For the lowest Ritz value, the variational principle gives
Because exact-arithmetic Krylov spaces are nested,
the lowest Ritz values obey
Thus unrestarted exact-arithmetic Lanczos supplies a descending sequence of variational upper bounds within the chosen sector. Floating-point loss of orthogonality and restarted algorithms can obscure simple step-by-step monotonicity, so implementations should be judged by their documented convergence criteria rather than by this ideal property alone.
The residual is nearly free
Section titled “The residual is nearly free”Insert the projection identity into the Ritz equation:
Therefore
No additional full Hamiltonian application is needed when the recurrence data are reliable. A direct recomputation of is nevertheless a valuable independent check for selected final states.
An absolute residual has units of energy. A useful scale-aware report includes, for example,
with the denominator stated explicitly. There is no universal tolerance divorced from the Hamiltonian scale and the accuracy required of downstream observables.
Energy variance and the residual
Section titled “Energy variance and the residual”For a normalized Ritz vector, , so
Zero variance is equivalent to being an exact eigenvector of the represented Hermitian Hamiltonian. A small variance is a strong solver diagnostic, but it does not by itself identify which nearby eigenstate has been obtained when levels are clustered or degenerate.
Residuals and eigenvalue errors
Section titled “Residuals and eigenvalue errors”For a normalized approximate eigenvector of a Hermitian matrix, at least one exact eigenvalue lies within the residual norm:
This inclusion statement does not label the nearby eigenvalue. To bound a particular eigenvector or isolate a particular level, one also needs spectral separation and correct state identification. Near a degeneracy, a tiny residual can coexist with a rapidly rotating basis inside the nearly degenerate subspace.
What Controls Convergence
Section titled “What Controls Convergence”The full sector dimension sets the worst-case ceiling, but it does not predict how many steps a useful calculation needs. Convergence depends on the spectral measure seen by the seed,
and therefore on several coupled features.
- Ground-state overlap: a very small delays the appearance of the ground-state component.
- Spectral separation: an isolated extremal level is generally easier to resolve than a dense low-energy cluster.
- Spectral width and distribution: polynomial separation depends on the placement of all eigenvalues carrying seed weight, not only on the first gap.
- Requested output: the energy may converge before long-range correlations, entanglement quantities, or small transition amplitudes.
- Finite precision: loss of orthogonality can generate duplicate Ritz values and spoil ideal recurrence identities.
- Restart policy: a bounded Krylov dimension controls memory but changes the convergence history and may discard useful directions.
It is therefore poor practice to prescribe a fixed number of Lanczos steps for every size and coupling. Stop when the relevant residuals and observables satisfy declared criteria, then show that tightening those criteria leaves the conclusions unchanged.
Energy convergence can be misleadingly early
Section titled “Energy convergence can be misleadingly early”Let a normalized trial state be
with gap . Its energy error is
whereas an observable with an off-diagonal matrix element can have a leading error proportional to :
An apparently settled energy can therefore coexist with a less accurate observable. Monitor the requested observables alongside the Ritz value.
Worked Three-Level Example
Section titled “Worked Three-Level Example”Consider
The first diagonal coefficient is
After subtracting , normalization gives
Thus
with Ritz values
The lower estimate is
which is correctly above the exact ground energy . The next recurrence coefficient is
The normalized lower eigenvector of is , so the residual formula gives
The estimate is variational, but its residual is not yet small. At the third step,
whose eigenvalues are exactly , , and . The Krylov space has reached the full spectral support of the seed, so the finite problem is recovered exactly.
This toy example illustrates three general points.
- A small projected matrix can already provide a useful upper bound.
- The residual quantifies how incomplete that estimate remains.
- Exact termination occurs after the number of distinct eigenvalues carrying seed weight, which can be much smaller than the ambient basis dimension in special cases.
Vectors, Memory, and Reconstruction
Section titled “Vectors, Memory, and Reconstruction”If only Ritz values and residual estimates are needed, the three-term recurrence can proceed while retaining only a few length- vectors plus the scalar coefficients. A many-body observable usually requires a Ritz vector, however:
There are three common storage patterns.
Store the Krylov basis
Section titled “Store the Krylov basis”Retaining all vectors permits direct Ritz-vector construction and full reorthogonalization. Its leading vector storage is
This can dominate memory even when itself is tiny.
Reconstruct in a second pass
Section titled “Reconstruct in a second pass”One can first save the recurrence coefficients, solve the small problem, then regenerate the Krylov sequence from the same seed and Hamiltonian action while accumulating the desired linear combination. This reduces stored-vector memory but approximately repeats the matrix-vector work. Exact reproducibility of the recurrence matters; nondeterministic parallel reductions and changed arithmetic order can complicate a naive second pass.
Restart or lock converged directions
Section titled “Restart or lock converged directions”Restarted methods cap the live subspace dimension, while locking preserves selected converged Ritz vectors. These strategies are essential in large calculations, but their details belong to Sparse Eigensolvers. A paper or notebook should identify the actual algorithm rather than using “Lanczos” as a catch-all label.
More Than One Low-Energy State
Section titled “More Than One Low-Energy State”The extremal Ritz values of can approximate several low-lying eigenvalues at once. Their convergence is not uniform. The lowest state may settle while the next few states still exchange order or mix within a cluster.
A single-vector Krylov sequence contains at most one direction in each exactly degenerate eigenspace: every polynomial acts there as the scalar . Nonzero overlap with several chosen basis vectors does not recover their multiplicity. To obtain the full degenerate space, use independent seeds with deflation or a block method. For an exactly degenerate eigenspace , no numerical method is required to return a predetermined basis inside . The invariant object is the projector
not any particular orthonormal set . Compare subspaces, symmetry labels, and projector-valued observables when individual vectors can rotate.
Several safeguards are useful when excited states matter.
- Request more Ritz pairs than the minimum needed near a suspected cluster.
- Resolve all commuting symmetries available before interpreting degeneracy.
- Check each residual, not only the ground-state residual.
- Compare stable invariant subspaces rather than raw eigenvector components.
- Use independent seeds or block methods when a single seed has poor support.
- Compare neighboring sectors before claiming a global gap or degeneracy.
Interior eigenstates are a harder target than spectral edges. A plain ground-state Lanczos run should not be presented as a generic finite-energy eigensolver.
Spectral Functions from a Second Lanczos Run
Section titled “Spectral Functions from a Second Lanczos Run”Use an energy variable in this section; the laboratory angular frequency is , so a frequency-normalized density is . Once a normalized ground state and energy are available, define the zero-temperature resolvent for an operator :
The corresponding energy-resolved spectral measure is
For a global ground state, all transition energies are nonnegative. If is only a fixed-number ground state and changes number, need not be positive; specify the chemical-potential reference when interpreting addition or removal energies. This one-sided resolvent is not itself the full retarded commutator susceptibility, which also contains the reverse transition term. Its full physical interpretation and variants are developed in Spectral Functions. The comparative numerical workflow, including matched-kernel checks against direct sums and time evolution, is developed in Dynamical Correlation Functions Numerically. Lanczos enters through the response seed
If , the spectrum vanishes for that state and operator. Otherwise choose
and run Lanczos on in the sector reached by . If the resulting tridiagonal coefficients are and , the order- approximation is
Equivalently,
If
then
The small tridiagonal problem therefore supplies both approximate pole locations and nonnegative weights.
The operator usually changes sector
Section titled “The operator usually changes sector”If lies in sector and carries definite conserved quantum numbers, then
For example, a momentum- operator maps a ground state of momentum to momentum , while a particle-addition operator changes particle number by one. The ground-state run and the response run may therefore use different reduced bases. Applying the wrong sector representation can silently erase the signal or produce an invalid Hamiltonian action.
Broadening is a display and resolution choice
Section titled “Broadening is a display and resolution choice”At finite size, the exact spectrum is a sum of delta functions. Evaluating at
gives a Lorentzian-broadened plot:
For discrete poles this is
Unless a physical self-energy or coupling to an environment has been included, is not a measured lifetime. It is a numerical resolution parameter. A reproducible spectrum reports , the line shape, system size, boundary conditions, sector, frequency grid, and whether the displayed features persist when these choices are varied.
Moments and sum rules
Section titled “Moments and sum rules”The zeroth moment is exact by construction:
More generally, define
In exact arithmetic, the -step Lanczos quadrature obeys
provided the Krylov process has not terminated earlier. This moment-matching property explains why a modest tridiagonal representation can reproduce integrated spectral information before every individual finite-size pole has converged.
These moments refer to the unbroadened discrete pole measure. A Lorentzian has long tails: its ordinary absolute first moment and higher moments diverge, so moments of the plotted Lorentzian curve cannot be substituted into this identity. Use the pole positions and weights, or state a finite-window convention separately. Use independent operator identities from Sum Rules as validation tests. Compare nonnegative weights, unbroadened moments, and the integrated weight before interpreting a visually smooth curve.
Finite-Precision Failure Modes
Section titled “Finite-Precision Failure Modes”The elegant three-term recurrence assumes exact arithmetic. Real calculations require an explicit policy for roundoff.
Loss of orthogonality and ghost Ritz values
Section titled “Loss of orthogonality and ghost Ritz values”As extremal Ritz pairs converge, floating-point Lanczos vectors tend to lose mutual orthogonality. The projected calculation can then rediscover an already converged direction and produce repeated or “ghost” Ritz values. A duplicate number in does not establish a physical degeneracy.
Possible responses include full reorthogonalization, selective or partial reorthogonalization, locking converged vectors, and carefully designed restarted methods. Each trades memory, orthogonalization cost, and robustness. Relevant diagnostics include
independently recomputed residuals, and stability under a stricter orthogonality policy.
Small overlap and false absence
Section titled “Small overlap and false absence”If the desired state has exactly zero seed overlap, it is mathematically inaccessible. If the overlap is merely tiny, the state may appear only after many iterations and can be lost amid roundoff or restart filtering. Multiple independent seeds and symmetry-aware seeds help distinguish genuine spectral absence from poor sampling of the invariant subspace.
Near-degenerate clusters
Section titled “Near-degenerate clusters”Individual Ritz vectors can rotate strongly while the low-energy invariant subspace is already accurate. Compare projectors, principal angles, or symmetry-resolved matrix elements rather than demanding componentwise agreement between arbitrary bases of the same cluster.
Interior states and dense spectra
Section titled “Interior states and dense spectra”Plain Lanczos favors spectral edges. High-energy or interior states in a many-body spectrum can be surrounded by exponentially many nearby levels. Shift-invert or polynomial filtering may improve targeting, but factorization cost, conditioning, and memory can become decisive. These are different computational regimes, not minor settings on a ground-state run.
Nondeterministic arithmetic
Section titled “Nondeterministic arithmetic”Parallel sparse matrix-vector products and reductions may change summation order between runs. Bitwise-identical Ritz vectors are then an inappropriate reproducibility criterion, especially inside degenerate subspaces. Residuals, invariant quantities, and stated numerical tolerances are the meaningful comparison targets.
Non-Hermitian operators
Section titled “Non-Hermitian operators”The standard real-symmetric or Hermitian Lanczos structure does not apply unchanged to a generic non-Hermitian matrix. Arnoldi, biorthogonal Lanczos variants, or specialized structure-preserving methods are needed, with different stability questions. Do not use a Hermitian residual or variational interpretation outside its assumptions.
Physical Limitations After Numerical Convergence
Section titled “Physical Limitations After Numerical Convergence”A converged Krylov calculation can still answer the wrong physical question.
One sector is not the global spectrum
Section titled “One sector is not the global spectrum”Lanczos finds the lowest state visible in the chosen invariant block. The global finite-system ground state is
If the winning sector is not known analytically, compare all plausible sectors. Crossings between sector minima can be physical and should not be hidden by fixing labels too early.
One size is not a phase
Section titled “One size is not a phase”An essentially exact ground state on one cluster does not establish long-range order, a thermodynamic gap, or a phase transition. Those claims require controlled size sequences, compatible geometries, and a dedicated finite-size-scaling analysis.
A few states are not a thermal trace
Section titled “A few states are not a thermal trace”Low-temperature observables may be dominated by a small spectral window, but a complete finite-temperature trace is
A handful of low Ritz pairs is not generally enough at moderate or high temperature. Finite-temperature Lanczos methods add stochastic trace estimation and further approximations; they must be documented separately.
A broadened finite spectrum is not automatically a continuum
Section titled “A broadened finite spectrum is not automatically a continuum”The apparent smoothness of depends on , level spacing, geometry, and system size. Features narrower than the finite-size spacing or comparable to the chosen broadening need a scaling study before receiving a continuum interpretation.
Exercises
Section titled “Exercises”1. Shift invariance and missing support
Section titled “1. Shift invariance and missing support”Prove that
Then show that if for an eigenvector of , every vector in either Krylov space is orthogonal to .
Solution
The binomial theorem gives
Thus each generator of belongs to . Replacing by gives the reverse inclusion, so the spaces are equal.
If
then
for every nonnegative integer . Every linear combination of the Krylov generators is therefore orthogonal to . A scalar shift cannot repair missing seed support.
4. Zeroth spectral sum rule
Section titled “4. Zeroth spectral sum rule”Using the energy variable , let
Show that its total weight is . Then show that the -pole Lanczos representation has the same total weight.
Solution
Integrating and inserting completeness gives
The Lanczos pole weights are
Because the eigenvectors of form an orthonormal basis,
Therefore
This check can pass even when individual poles have not converged, so it complements rather than replaces frequency-resolved tests.
5. Diagnose a claimed degeneracy
Section titled “5. Diagnose a claimed degeneracy”A computation in one symmetry block reports three nearly identical lowest Ritz values, but the associated Lanczos vectors have lost orthogonality. Design a minimal sequence of checks that distinguishes a physical threefold degeneracy from ghost Ritz values.
Solution
A defensible sequence is:
- Reconstruct all three Ritz vectors and directly recompute their residuals.
- Measure their mutual overlaps and, if the Krylov basis was stored, .
- Repeat with full or stricter selective reorthogonalization and locking of converged directions.
- Use independent start vectors or a block method so the candidate subspace is sampled in more than one way.
- Resolve every available commuting symmetry and check whether the states carry distinct labels.
- Compare the projector onto the candidate three-dimensional subspace across solver settings.
- Benchmark a smaller related sector against complete diagonalization.
If the multiplicity disappears under reorthogonalization or the putative vectors collapse onto the same direction, the repeated values were numerical ghosts. If three linearly independent, small-residual states persist and their invariant subspace is stable, the result supports a physical degeneracy of the represented finite problem. Establishing a thermodynamic degeneracy still requires finite-size analysis.
References
Section titled “References”- E. R. Gagliano and C. A. Balseiro, “Dynamical Properties of Quantum Many-Body Systems at Zero Temperature,” Physical Review Letters 59, 2999–3002 (1987), doi:10.1103/PhysRevLett.59.2999.
- E. R. Gagliano and C. A. Balseiro, “Dynamic Correlation Functions in Quantum Many-Body Systems at Zero Temperature,” Physical Review B 38, 11766–11773 (1988), doi:10.1103/PhysRevB.38.11766.
- E. Dagotto, “Correlated Electrons in High-Temperature Superconductors,” Reviews of Modern Physics 66, 763–840 (1994), doi:10.1103/RevModPhys.66.763.
- R. Haydock, V. Heine, and M. J. Kelly, “Electronic Structure Based on the Local Atomic Environment for Tight-Binding Bands,” Journal of Physics C: Solid State Physics 5, 2845–2858 (1972), doi:10.1088/0022-3719/5/20/004.
- C. Lanczos, “An Iteration Method for the Solution of the Eigenvalue Problem of Linear Differential and Integral Operators,” Journal of Research of the National Bureau of Standards 45, 255–282 (1950), doi:10.6028/jres.045.026.
- H. Q. Lin, “Exact Diagonalization of Quantum-Spin Models,” Physical Review B 42, 6561–6567 (1990), doi:10.1103/PhysRevB.42.6561.
- C. C. Paige, “Error Analysis of the Lanczos Algorithm for Tridiagonalizing a Symmetric Matrix,” Journal of the Institute of Mathematics and Its Applications 18, 341–349 (1976), doi:10.1093/imamat/18.3.341.
- J. Jaklič and P. Prelovšek, “Finite-Temperature Properties of Doped Antiferromagnets,” Advances in Physics 49, 1–92 (2000), doi:10.1080/000187300243381.
- Y. Saad, Numerical Methods for Large Eigenvalue Problems, revised edition, SIAM, 2011, doi:10.1137/1.9781611970739.
- A. W. Sandvik, “Computational Studies of Quantum Spin Systems,” in AIP Conference Proceedings 1297, 135–338 (2010), doi:10.1063/1.3518900.
- B. N. Parlett and D. S. Scott, “The Lanczos Algorithm with Selective Orthogonalization,” Mathematics of Computation 33, 217–238 (1979), doi:10.1090/S0025-5718-1979-0514820-3.
- J. K. Cullum and R. A. Willoughby, Lanczos Algorithms for Large Symmetric Eigenvalue Computations, Birkhäuser, 1985.