Skip to content

Variational Monte Carlo Preview

Variational Monte Carlo, or VMC, evaluates expectation values of a parameterized trial state by stochastic sampling. Its central move is to rewrite a high-dimensional quantum expectation as an ordinary average over configurations distributed according to ∣Ψθ∣2\lvert\Psi_\theta\rvert^2.

The method combines three logically distinct ingredients:

  1. a variational family Ψθ\Psi_\theta that encodes the physics one is willing to represent;
  2. a Monte Carlo estimator of the energy and other observables for fixed θ\theta;
  3. a stochastic optimization that changes θ\theta using noisy estimates.

Only the first ingredient is covered by the exact variational upper-bound theorem. Sampling and optimization introduce additional uncertainty and bias that must be analyzed separately.

Required background. The Variational Principle supplies the bound, Trial Wavefunctions and Variational Parameters supply states and gradients, and Monte Carlo Basics explains sampling and uncertainty. Variational Many-Body States compares practical ansätze.

Let RR denote a complete configuration. Depending on the problem, it may collect particle positions,

R=(r1,…,rN),R=(\mathbf r_1,\ldots,\mathbf r_N),

occupation numbers, spin labels, lattice configurations, or a mixture of continuous and discrete variables. The symbol

∫dR\int dR

will stand for the corresponding integrals and sums.

Choose a nonzero trial wavefunction Ψθ(R)\Psi_\theta(R) with real parameters θ=(θ1,…,θd)\theta=(\theta^1,\ldots,\theta^d). Its squared norm is

Zθ=∫dR ∣Ψθ(R)∣2,Z_\theta = \int dR\,\lvert\Psi_\theta(R)\rvert^2,

and its normalized configuration density is

pθ(R)=∣Ψθ(R)∣2Zθ.p_\theta(R) = \frac{\lvert\Psi_\theta(R)\rvert^2}{Z_\theta}.

The wavefunction itself may be real, complex, positive, sign-changing, or antisymmetric. The sampling density is nevertheless nonnegative.

For a trial state in the operator domain D(A)D(A), define its local estimator by

AL(R)=(AΨθ)(R)Ψθ(R)A_{\mathrm L}(R) = \frac{(A\Psi_\theta)(R)}{\Psi_\theta(R)}

wherever Ψθ(R)≠0\Psi_\theta(R)\neq0. Then

⟨Ψθ∣A∣Ψθ⟩⟨Ψθ∣Ψθ⟩=∫dR pθ(R)AL(R).\frac{\langle\Psi_\theta\rvert A\lvert\Psi_\theta\rangle} {\langle\Psi_\theta\vert\Psi_\theta\rangle} = \int dR\,p_\theta(R)A_{\mathrm L}(R).

The identity follows by multiplying ALA_{\mathrm L} by ∣Ψθ∣2\lvert\Psi_\theta\rvert^2. It is the bridge from a quantum expectation value to a statistical average.

If AA is diagonal in the sampled configuration basis, then AL(R)A_{\mathrm L}(R) is simply its diagonal value. For a differential or off-diagonal operator, the local estimator contains derivatives or ratios of wavefunction amplitudes at connected configurations.

The formula is formal at nodes of Ψθ\Psi_\theta. A node has zero probability under pθp_\theta, but nearby singularities can still produce large fluctuations or even an infinite estimator variance. A set of probability zero is not automatically harmless.

For the Hamiltonian,

EL(R)=(HΨθ)(R)Ψθ(R),E_{\mathrm L}(R) = \frac{(H\Psi_\theta)(R)}{\Psi_\theta(R)},

and the exact variational energy at fixed parameters is

E(θ)=⟨EL⟩pθ.E(\theta) = \langle E_{\mathrm L}\rangle_{p_\theta}.

This ratio uses the full operator action. A state with finite quadratic-form energy but outside D(H)D(H) can require a different estimator. For instance, applying the second derivative to e−a∣x∣e^{-a|x|} while discarding its delta distribution gives an incorrect oscillator kinetic energy, not merely a noisy estimate.

For a continuum Hamiltonian

H=−∑i=1Nℏ22mi∇i2+V(R),H = -\sum_{i=1}^N \frac{\hbar^2}{2m_i}\nabla_i^2 +V(R),

the local energy is

EL(R)=−∑i=1Nℏ22mi∇i2Ψθ(R)Ψθ(R)+V(R).E_{\mathrm L}(R) = -\sum_{i=1}^N \frac{\hbar^2}{2m_i} \frac{\nabla_i^2\Psi_\theta(R)}{\Psi_\theta(R)} +V(R).

Where a smooth branch of ln⁡Ψθ\ln\Psi_\theta exists, one may use

∇i2ΨθΨθ=∇i2ln⁡Ψθ+(∇iln⁡Ψθ)⋅(∇iln⁡Ψθ).\frac{\nabla_i^2\Psi_\theta}{\Psi_\theta} ={} \nabla_i^2\ln\Psi_\theta + (\nabla_i\ln\Psi_\theta) \mathbin{\cdot} (\nabla_i\ln\Psi_\theta).

For a complex wavefunction, the last dot product does not complex-conjugate the first factor. This logarithmic form often exposes short-distance cancellations and avoids separately evaluating very large amplitudes, but nodes and derivative accuracy still require care.

For self-adjoint HH, the expectation E(θ)E(\theta) is real. The pointwise local energy can nevertheless be complex when Ψθ\Psi_\theta is complex. In an exact calculation its imaginary part averages to zero; a persistent sampled imaginary mean is therefore a useful warning about boundary terms, coding errors, or unconverged statistics.

Zero variance and the Schrödinger residual

Section titled “Zero variance and the Schrödinger residual”

The local-energy variance is

σL2=⟨∣EL−E∣2⟩pθ.\sigma_{\mathrm L}^2 = \left\langle \left\lvert E_{\mathrm L}-E\right\rvert^2 \right\rangle_{p_\theta}.

Assume first that Ψθ≠0\Psi_\theta\ne0 almost everywhere with respect to the configuration-space integration measure (not merely its own Born probability). Substitution then gives

σL2=1Zθ∫dR ∣(H−E)Ψθ(R)∣2=∥(H−E)Ψθ∥2∥Ψθ∥2.\begin{aligned} \sigma_{\mathrm L}^2 &= \frac{1}{Z_\theta} \int dR\, \left\lvert (H-E)\Psi_\theta(R) \right\rvert^2 \\ &= \frac{ \left\lVert(H-E)\Psi_\theta\right\rVert^2 }{ \left\lVert\Psi_\theta\right\rVert^2 }. \end{aligned}

Thus the local-energy variance is the squared norm of the stationary Schrödinger residual, divided by the state norm. When Ψθ\Psi_\theta lies in the operator domain of HH, this is also the usual energy variance.

If the trial state is an exact eigenstate,

HΨθ=EΨθ,H\Psi_\theta = E\Psi_\theta,

then

EL(R)=EE_{\mathrm L}(R)=E

wherever the ratio is defined, and σL2=0\sigma_{\mathrm L}^2=0. Conversely, a normalized pure state with zero residual variance is an eigenstate. This is the zero-variance principle.

The result is stronger than the statement that an eigenstate has the correct mean energy: every sampled configuration returns the same local energy. Near a good eigenstate, reduced local-energy fluctuations often make VMC statistically efficient.

Two cautions matter:

  • A small energy error does not universally imply a proportionally small variance, or vice versa, without information about spectral gaps and state overlap.
  • The Rayleigh quotient may be finite for a state in the quadratic-form domain even when HΨH\Psi is not square-integrable. In that case the energy exists but the local-energy variance can diverge.

There is an additional support caveat in discrete bases and states with exact zeros on regions of nonzero measure. Let PSP_S project onto configurations where Ψθ≠0\Psi_\theta\ne0. In general the sampled variance is only

σL2=∥PS(H−E)Ψθ∥2Zθ,\sigma_{\mathrm L}^2 =\frac{\|P_S(H-E)\Psi_\theta\|^2}{Z_\theta},

while the full residual includes the extra nonnegative term ∥(I−PS)HΨθ∥2/Zθ\|(I-P_S)H\Psi_\theta\|^2/Z_\theta. Equality holds when that omitted term vanishes, including a symmetry sector preserved by HH. Thus zero sampled local variance implies an eigenstate only with this support condition. The mean-energy identity needs no such extra term because its integrand contains Ψθ∗\Psi_\theta^*.

Correct cusp, boundary and nodal behavior also matters statistically: it can cancel physical singularities between kinetic and potential terms and reduce heavy local-energy tails.

Independent samples from pθp_\theta are rarely available in a complicated many-body problem. VMC commonly uses a Markov chain with stationary density pθp_\theta.

Given a proposal density q(R′∣R)q(R'\mid R), the Metropolis–Hastings acceptance probability is

A(R→R′)=min⁡[1,pθ(R′)q(R∣R′)pθ(R)q(R′∣R)].\begin{aligned} A(R\to R') = \min\left[ 1, \frac{ p_\theta(R')q(R\mid R') }{ p_\theta(R)q(R'\mid R) } \right]. \end{aligned}

For a symmetric proposal,

A(R→R′)=min⁡[1,∣Ψθ(R′)∣2∣Ψθ(R)∣2].A(R\to R') = \min\left[ 1, \frac{\lvert\Psi_\theta(R')\rvert^2} {\lvert\Psi_\theta(R)\rvert^2} \right].

Normalization cancels from the ratio, so VMC does not require prior knowledge of ZθZ_\theta. Detailed balance is a sufficient route to the desired stationary distribution, but stationarity alone is not enough: the chain must also explore every relevant region on the time scale of the calculation.

Nodes or separated modes can obstruct mixing. A local proposal may remain trapped in one nodal pocket or one metastable region even though its acceptance rate looks healthy. Acceptance rate is therefore not an ergodicity certificate.

For a fixed antisymmetric trial wavefunction, ordinary VMC samples the positive density ∣Ψθ∣2\lvert\Psi_\theta\rvert^2. The fermionic sign or phase enters the local energy through amplitude ratios and derivatives, not through a fluctuating signed sampling weight. In this limited sense, evaluating a specified fermionic trial state does not have the same average-sign problem as many projection or path-integral methods.

The hard fermionic physics has not disappeared. The antisymmetry and nodal surface must be represented by the ansatz, and poor nodes can dominate the variational bias. Fixed-node projection is a separate approximation associated with diffusion Monte Carlo, not a property of VMC itself.

After equilibration, suppose a chain provides configurations

R1,R2,…,RM.R_1,R_2,\ldots,R_M.

The sample-mean energy estimator is

E^M=1M∑s=1MEL(Rs).\widehat E_M = \frac{1}{M} \sum_{s=1}^M E_{\mathrm L}(R_s).

For a complex local energy, one normally reports the real part and separately checks that the sampled imaginary mean is statistically consistent with zero.

For independent samples with finite variance, the root-mean-square error of the complex mean is σL/M\sigma_{\mathrm L}/\sqrt M; the standard error of its reported real part instead uses the real-part variance below. Markov-chain samples are correlated, so the relevant quantity is the autocovariance of the real local-energy fluctuations. Let

δEs=Re⁡EL(Rs)−E,\delta E_s = \operatorname{Re}E_{\mathrm L}(R_s)-E,

and define

Ck=E[δEsδEs+k],ρk=CkC0.C_k = \mathbb E[\delta E_s\delta E_{s+k}], \qquad \rho_k=\frac{C_k}{C_0}.

The integrated autocorrelation time is

τint=12+∑k=1∞ρk,\tau_{\mathrm{int}} = \frac{1}{2} + \sum_{k=1}^{\infty}\rho_k,

when the sum converges. For a long stationary chain,

Var⁡(E^M)≈2τintσR2M=σR2Meff,\operatorname{Var}(\widehat E_M) \approx \frac{2\tau_{\mathrm{int}}\sigma_{\mathrm R}^2}{M} = \frac{\sigma_{\mathrm R}^2}{M_{\mathrm{eff}}},

with

σR2=Var⁡(Re⁡EL),Meff=M2τint.\sigma_{\mathrm R}^2 = \operatorname{Var} \left(\operatorname{Re}E_{\mathrm L}\right), \qquad M_{\mathrm{eff}} = \frac{M}{2\tau_{\mathrm{int}}}.

For a real local energy, σR2=σL2\sigma_{\mathrm R}^2=\sigma_{\mathrm L}^2. For a complex local energy, the residual norm also contains fluctuations of the imaginary part, whereas the quoted real-energy standard error does not.

The central-limit approximation requires adequate mixing and sufficiently light tails. If ELE_{\mathrm L} has rare, extreme excursions or infinite variance, a familiar-looking standard error can be meaningless. Independent chains, trace diagnostics, blocking or batching, and tail inspection are not optional decorations.

The reusable probability theory and error-bar machinery are developed in Monte Carlo Basics. This page keeps the emphasis on what those quantities mean for a variational quantum state.

For every fixed admissible trial state, the exact Rayleigh quotient obeys

E(θ)≥E0.E(\theta)\geq E_0.

The finite-sample estimate does not obey the inequality sample by sample. It has the form

E^M=E(θ)+δstat+δeq+δimpl,\widehat E_M = E(\theta) + \delta_{\mathrm{stat}} + \delta_{\mathrm{eq}} + \delta_{\mathrm{impl}},

where statistical fluctuation, incomplete equilibration, and implementation error have no common one-sided sign. A reported VMC number can fall below E0E_0 even when the underlying variational energy is above it.

A controlled one-sided confidence limit on E(θ)E(\theta) also provides a probabilistic upper limit on E0E_0, with its stated coverage and systematic assumptions. The point estimate itself remains noisy, and a confidence limit is not a deterministic variational bound. A symmetric one-standard-error interval supplies neither guarantee by itself.

Optimization creates another subtlety. If many noisy estimates are compared and the smallest is selected, the winner is preferentially associated with a downward fluctuation. Reusing the same sample to optimize and to report the final energy can therefore produce selection bias. A fresh validation sample at the final parameters helps separate optimization noise from final estimation.

Worked example: Gaussian oscillator recast as VMC

Section titled “Worked example: Gaussian oscillator recast as VMC”

The Variational Estimate for the Harmonic Oscillator derives the deterministic result. Here the same family is recast as a sampling problem.

Take

ψb(x)=1(πb2)1/4exp⁡(−x22b2),\psi_b(x) = \frac{1}{(\pi b^2)^{1/4}} \exp\left(-\frac{x^2}{2b^2}\right),

so that

pb(x)=1πbexp⁡(−x2b2).p_b(x) = \frac{1}{\sqrt\pi b} \exp\left(-\frac{x^2}{b^2}\right).

For

H=−ℏ22md2dx2+12mω2x2,H = -\frac{\hbar^2}{2m}\frac{d^2}{dx^2} + \frac{1}{2}m\omega^2x^2,

the local energy is

EL(x)=ℏ22mb2+12(mω2−ℏ2mb4)x2.E_{\mathrm L}(x) = \frac{\hbar^2}{2mb^2} + \frac{1}{2} \left( m\omega^2- \frac{\hbar^2}{mb^4} \right)x^2.

Sampling xx from pbp_b and using ⟨x2⟩=b2/2\langle x^2\rangle=b^2/2 gives

E(b)=ℏ24mb2+mω2b24.E(b) = \frac{\hbar^2}{4mb^2} + \frac{m\omega^2b^2}{4}.

Let

ℓ=ℏmω,s=bℓ.\ell=\sqrt{\frac{\hbar}{m\omega}}, \qquad s=\frac{b}{\ell}.

The exact ground-state width is b=ℓb=\ell. At that point the coefficient of x2x^2 in ELE_{\mathrm L} vanishes, so every sample returns

EL(x)=ℏω2.E_{\mathrm L}(x)=\frac{\hbar\omega}{2}.

For a nonoptimal width, the local energy fluctuates with x2x^2. Its exact variance is

σL2=(ℏω)28(s2−s−2)2.\sigma_{\mathrm L}^2 = \frac{(\hbar\omega)^2}{8} \left(s^2-s^{-2}\right)^2.

This example displays all three layers cleanly. The family contains the exact ground state, the local-energy variance diagnoses the residual, and finite sampling estimates the same analytic Rayleigh quotient with a parameter-dependent error bar.

The deterministic geometry of parameter optimization is developed in Variational Parameters. VMC makes its gradients into covariance estimators.

For real parameters, define logarithmic derivatives

Oi(R)=∂iln⁡Ψθ(R).O_i(R) = \partial_i\ln\Psi_\theta(R).

Thus

∂iΨθ(R)=Oi(R)Ψθ(R).\partial_i\Psi_\theta(R) = O_i(R)\Psi_\theta(R).

Assume HH is independent of θ\theta, the required derivatives can be moved through the integrals, and boundary terms are controlled. The logarithmic-derivative representation also assumes that ∂iΨ=OiΨ\partial_i\Psi=O_i\Psi does not omit contributions on zero-amplitude configurations; full support almost everywhere is sufficient. A parameter that turns on amplitude outside the present support requires the unsampled derivative contribution explicitly. Differentiating the Rayleigh quotient and using self-adjointness gives

∂iE=2Re⁡[⟨Oi∗EL⟩−⟨Oi∗⟩⟨EL⟩].\partial_iE = 2\operatorname{Re} \left[ \left\langle O_i^*E_{\mathrm L}\right\rangle - \left\langle O_i^*\right\rangle \left\langle E_{\mathrm L}\right\rangle \right].

Equivalently,

∂iE=2Re⁡⟨Oi∗(EL−E)⟩.\partial_iE = 2\operatorname{Re} \left\langle O_i^*(E_{\mathrm L}-E) \right\rangle.

For a real positive trial state, this reduces to twice the covariance of OiO_i and ELE_{\mathrm L}. The formula is valuable because it does not require a separate pointwise derivative of ELE_{\mathrm L}: the Hamiltonian’s self-adjointness has converted the derivative into a covariance.

Replacing the expectations by sample means produces a stochastic gradient. Its noise is correlated across parameters because every component uses the same configurations. Near an eigenstate, the factor EL−EE_{\mathrm L}-E becomes small, reflecting the zero-variance principle.

Finite-sample covariance estimators can still be biased at order 1/M1/M, and adaptive reuse of samples complicates the error analysis. Gradient convergence should be checked separately from energy convergence.

Stochastic reconfiguration and natural gradient

Section titled “Stochastic reconfiguration and natural gradient”

The logarithmic derivatives also give the pullback of the projective state metric:

Sij=Re⁡[⟨Oi∗Oj⟩−⟨Oi∗⟩⟨Oj⟩].S_{ij} = \operatorname{Re} \left[ \langle O_i^*O_j\rangle - \langle O_i^*\rangle \langle O_j\rangle \right].

For any real vector viv^i,

viSijvj≥0.v^iS_{ij}v^j\geq0.

Null directions correspond to parameter combinations that do not change the physical ray to first order, such as redundant coordinates or pure normalization and phase changes.

A natural-gradient or stochastic-reconfiguration step solves schematically

Sij δθj=−η ∂iE,S_{ij}\,\delta\theta^j = -\eta\,\partial_iE,

where η\eta controls the step size. This chooses a small change in the quantum state rather than a small change measured only by coordinate distance.

The same metric appears in imaginary-time projection and the Time-Dependent Variational Principle. Stochastic reconfiguration is therefore not merely a preconditioner chosen by convenience; in its ideal form it is a sampled state-space projection.

In practice, SS is itself noisy and often ill-conditioned. Gauge fixing, rank truncation, diagonal shifts, trust regions, or pseudoinverses may be needed. Every such regularization changes the update and should be included in sensitivity tests.

Other optimization strategies include direct stochastic gradients, variance minimization, and the linear method. No optimizer repairs a trial family that omits the relevant symmetry, nodes, correlations, or asymptotic behavior.

A VMC ansatz must be physically admissible, but it must also make the sampled quantities tractable. Useful requirements include:

  • inexpensive evaluation of amplitude ratios or logarithmic amplitudes;
  • exact enforcement of required exchange symmetry and quantum numbers;
  • correct boundary, cusp, and asymptotic behavior where known;
  • stable derivatives for ELE_{\mathrm L} and OiO_i;
  • support broad enough to cover every relevant configuration sector;
  • a parameterization whose metric is not needlessly singular.

Common continuum fermion states combine a Slater determinant with a symmetric Jastrow factor,

Ψθ(R)=Dθ(R)eJθ(R).\Psi_\theta(R) = D_\theta(R)e^{J_\theta(R)}.

The determinant enforces antisymmetry, while the Jastrow factor represents symmetric correlations and can encode cusp conditions. Backflow coordinates, pairing determinants, and Pfaffian forms enrich the nodal and pairing structure.

On lattices, correlator products, projected mean-field states, tensor-network amplitudes, and neural-network wavefunctions can all be sampled when their amplitudes and local connections are evaluable. Expressivity is not a guarantee of accuracy: a larger family may be harder to mix, optimize, condition, and validate.

Neural quantum states are therefore best viewed as flexible VMC ansätze, not as a separate variational theorem. Their claims require the same energy, variance, symmetry, convergence, and independent-benchmark checks as traditional trial states.

The local-estimator identity applies to any operator for which the expectation exists. For a Hermitian observable AA,

⟨A⟩θ=⟨AL⟩pθ.\langle A\rangle_\theta = \left\langle A_{\mathrm L}\right\rangle_{p_\theta}.

Unlike the energy, a generic observable has no variational upper-bound property. It also need not be stationary to first order in the wavefunction error. A trial state can therefore have an excellent energy while giving a noticeably biased density, correlation function, response, or transition matrix element.

Variance and mixing are observable-dependent. A chain that estimates the energy efficiently may have a much longer autocorrelation time for a collective order parameter. Error bars must be computed for the observable actually reported.

Off-diagonal estimators may involve large amplitude ratios and heavier tails than the energy. Their finite variance should be checked rather than assumed.

Let θ⋆\theta_\star minimize the exact variational energy within the chosen family, and let θ^\widehat\theta be the parameters returned by a noisy optimization. Then a useful conceptual decomposition is

E^(θ^)−E0=E(θ⋆)−E0⏟ansatz bias+E(θ^)−E(θ⋆)⏟optimization error+E^(θ^)−E(θ^)⏟estimation error.\widehat E(\widehat\theta)-E_0 = {} \underbrace{E(\theta_\star)-E_0}_{\text{ansatz bias}} + \underbrace{E(\widehat\theta)-E(\theta_\star)} _{\text{optimization error}} + \underbrace{\widehat E(\widehat\theta)-E(\widehat\theta)} _{\text{estimation error}}.

For an exact global minimum within an admissible family, the first two terms are nonnegative. The last term has either sign and includes more than finite-sample variance if equilibration or implementation is imperfect.

The remaining errors have different causes:

  • ansatz bias: the family cannot represent the target state;
  • optimization error: the algorithm does not reach the best state in the family;
  • sampling variance: a finite correlated sample fluctuates;
  • equilibration and mixing bias: the chain does not represent pθp_\theta;
  • estimator pathology: local values have heavy or nonintegrable tails;
  • implementation error: derivatives, Hamiltonian terms, boundary conditions, or precision are wrong;
  • model or discretization error: the simulated Hamiltonian differs from the intended physical problem.

Only the sampling standard error is expected to scale as M−1/2M^{-1/2} under stationary central-limit conditions; the variance of the mean scales as M−1M^{-1}.

Effective sample size for exponential correlation

Section titled “Effective sample size for exponential correlation”

Suppose ρk=rk\rho_k=r^k with 0≤r<10\leq r\lt1. Compute τint\tau_{\mathrm{int}} and MeffM_{\mathrm{eff}}. What fraction of MM remains effective when r=0.8r=0.8?

Solution

The geometric series gives

τint=12+∑k=1∞rk=12+r1−r=1+r2(1−r).\begin{aligned} \tau_{\mathrm{int}} &= \frac{1}{2} + \sum_{k=1}^{\infty}r^k \\ &= \frac{1}{2} + \frac{r}{1-r} = \frac{1+r}{2(1-r)}. \end{aligned}

Hence

Meff=M1−r1+r.M_{\mathrm{eff}} = M\frac{1-r}{1+r}.

For r=0.8r=0.8,

Meff=M9.M_{\mathrm{eff}}=\frac{M}{9}.

Nine stored configurations then carry roughly the mean-estimation information of one independent draw, under this idealized correlation model.

For real θi\theta^i, use ∂iΨ=OiΨ\partial_i\Psi=O_i\Psi to derive

∂iE=2Re⁡[⟨Oi∗EL⟩−⟨Oi∗⟩⟨EL⟩].\partial_iE = 2\operatorname{Re} \left[ \langle O_i^*E_{\mathrm L}\rangle - \langle O_i^*\rangle\langle E_{\mathrm L}\rangle \right].
Solution

Let

N=⟨Ψ∣H∣Ψ⟩,Z=⟨Ψ∣Ψ⟩,E=NZ.\begin{aligned} N&=\langle\Psi\rvert H\lvert\Psi\rangle, \\ Z&=\langle\Psi\vert\Psi\rangle, \qquad E=\frac{N}{Z}. \end{aligned}

Self-adjointness gives

∂iN=⟨∂iΨ∣H∣Ψ⟩+⟨Ψ∣H∣∂iΨ⟩=2ZRe⁡⟨Oi∗EL⟩.\begin{aligned} \partial_iN &= \langle\partial_i\Psi\rvert H\lvert\Psi\rangle + \langle\Psi\rvert H\lvert\partial_i\Psi\rangle \\ &= 2Z\operatorname{Re} \langle O_i^*E_{\mathrm L}\rangle. \end{aligned}

Similarly,

∂iZ=2ZRe⁡⟨Oi⟩.\partial_iZ = 2Z\operatorname{Re}\langle O_i\rangle.

Differentiating E=N/ZE=N/Z gives

∂iE=2Re⁡[⟨Oi∗EL⟩−E⟨Oi∗⟩].\partial_iE = 2\operatorname{Re} \left[ \langle O_i^*E_{\mathrm L}\rangle -E\langle O_i^*\rangle \right].

Since the exact local-energy mean equals the real number EE, this is the stated covariance form.

A sampled value below the ground-state energy

Section titled “A sampled value below the ground-state energy”

A VMC run returns E^=−1.01\widehat E=-1.01 with estimated standard error 0.030.03, while the exact ground-state energy is known to be E0=−1E_0=-1. Does this violate the variational principle? What should be checked?

Solution

No. The variational principle constrains the exact Rayleigh quotient E(θ)E(\theta) of the trial state, not every finite-sample realization E^\widehat E. The observed difference is only one third of the quoted standard error.

One should check that the error estimate accounts for autocorrelation, that the chain is equilibrated and mixing, that the local-energy variance is finite, and that no implementation or discretization bias is present. If the parameters were selected using the same noisy sample, a fresh validation run is also appropriate. Only a controlled one-sided confidence statement could turn the stochastic result into a probabilistic upper bound.

Zero sampled variance with a nonzero residual

Section titled “Zero sampled variance with a nonzero residual”

In a two-state configuration basis take H=vσxH=v\sigma_x, v≠0v\ne0, and Ψ=∣0⟩\Psi=|0\rangle. What does Born-density sampling return for the local energy? Compare it with the full residual. Then examine the energy derivative for Ψθ=cos⁡θ∣0⟩+sin⁡θ∣1⟩\Psi_\theta=\cos\theta|0\rangle+\sin\theta|1\rangle at θ=0\theta=0.

Solution

Every sample is configuration 00, where (HΨ)0=0(H\Psi)_0=0. Hence EL=0E_{\mathrm L}=0, its sampled variance is zero, and its mean is the correct E=0E=0. But HΨ=v∣1⟩H\Psi=v|1\rangle gives full residual norm squared v2v^2; the state is not an eigenstate.

Along the parameterized family, E(θ)=vsin⁡2θE(\theta)=v\sin2\theta, so E′(0)=2vE'(0)=2v. At the only sampled configuration, O0=0O_0=0; the covariance estimator would incorrectly give zero if applied at this support-changing point. The missing derivative ∂θΨ1=1\partial_\theta\Psi_1=1 contributes where the present Born density vanishes. Away from θ=0\theta=0 with both amplitudes nonzero, the usual covariance identity recovers the derivative, though rare configurations can make estimation difficult.

  • G. Carleo and M. Troyer, “Solving the quantum many-body problem with artificial neural networks,” Science 355, 602–606 (2017), doi:10.1126/science.aag2302.
  • D. M. Ceperley, G. V. Chester, and M. H. Kalos, “Monte Carlo simulation of a many-fermion system,” Physical Review B 16, 3081–3099 (1977), doi:10.1103/PhysRevB.16.3081.
  • W. M. C. Foulkes, L. Mitas, R. J. Needs, and G. Rajagopal, “Quantum Monte Carlo simulations of solids,” Reviews of Modern Physics 73, 33–83 (2001), doi:10.1103/RevModPhys.73.33.
  • W. K. Hastings, “Monte Carlo sampling methods using Markov chains and their applications,” Biometrika 57, 97–109 (1970), doi:10.1093/biomet/57.1.97.
  • W. L. McMillan, “Ground State of Liquid He4,” Physical Review 138, A442–A451 (1965), doi:10.1103/PhysRev.138.A442.
  • N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, and E. Teller, “Equation of State Calculations by Fast Computing Machines,” Journal of Chemical Physics 21, 1087–1092 (1953), doi:10.1063/1.1699114.
  • S. Sorella, “Wave function optimization in the variational Monte Carlo method,” Physical Review B 71, 241103(R) (2005), doi:10.1103/PhysRevB.71.241103.
  • C. J. Umrigar, K. G. Wilson, and J. W. Wilkins, “Optimized trial wave functions for quantum Monte Carlo calculations,” Physical Review Letters 60, 1719–1722 (1988), doi:10.1103/PhysRevLett.60.1719.