Probabilistic algorithms

Buchman, O. ; Baer, R. Stochastic method for calculating the ground-state one-body density matrix of trapped Bose particles in one dimension. Phys. Rev. A 2017, 96, 033626. buchman2017.pdf
Arnon, E. ; Rabani, E. ; Neuhauser, D. ; Baer, R. Equilibrium configurations of large nanostructures using the embedded saturated-fragments stochastic density functional theory. J. Chem. Phys. 2017, 146, 224111.Abstract

An ab initio Langevin dynamics approach is developed based on stochastic density functional theory (sDFT) within a new embedded fragment formalism. The forces on the nuclei generated by sDFT contain a random component natural to Langevin dynamics and its standard deviation is used to estimate the friction term on each atom by satisfying the fluctuation–dissipation relation. The overall approach scales linearly with system size even if the density matrix is not local and is thus applicable to ordered as well as disordered extended systems. We implement the approach for a series of silicon nanocrystals (NCs) of varying size with a diameter of up to 3nm corresponding to Ne = 3000 electrons and generate a set of configurations that are distributed canonically at a fixed temperature, ranging from cryogenic to room temperature. We also analyze the structure properties of the NCs and discuss the reconstruction of the surface geometry.

Vlček, V. ; Eisenberg, H. R. ; Steinle-Neumann, G. ; Rabani, E. ; Neuhauser, D. ; Baer, R. Spontaneous charge carrier localization in extended one-dimensional systems. Phys. Rev. Lett. 2016, 116, 186401.Abstract

Charge carrier localization in extended atomic systems has been described previously as being driven by disorder, point defects, or distortions of the ionic lattice. Here we show for the first time by means of first-principles computations that charge carriers can spontaneously localize due to a purely electronic effect in otherwise perfectly ordered structures. Optimally tuned range-separated density functional theory and many-body perturbation calculations within the GW approximation reveal that in trans-polyacetylene and polythiophene the hole density localizes on a length scale of several nanometers. This is due to exchange-induced translational symmetry breaking of the charge density. Ionization potentials, optical absorption peaks, excitonic binding energies, and the optimally tuned range parameter itself all become independent of polymer length as it exceeds the critical localization length. Moreover, we find that lattice disorder and the formation of a polaron result from the charge localization in contrast to the traditional view that lattice distortions precede charge localization. Our results can explain experimental findings that polarons in conjugated polymers form instantaneously after exposure to ultrafast light pulses.

Neuhauser, D. ; Rabani, E. ; Cytter, Y. ; Baer, R. Stochastic Optimally Tuned Range-Separated Hybrid Density Functional Theory. J. Phys. Chem. A 2015, 120, 3071–3078.Abstract

We develop a stochastic formulation of the optimally tuned range-separated hybrid density functional theory that enables significant reduction of the computational effort and scaling of the nonlocal exchange operator at the price of introducing a controllable statistical error. Our method is based on stochastic representations of the Coulomb convolution integral and of the generalized Kohn–Sham density matrix. The computational cost of the approach is similar to that of usual Kohn–Sham density functional theory, yet it provides a much more accurate description of the quasiparticle energies for the frontier orbitals. This is illustrated for a series of silicon nanocrystals up to sizes exceeding 3000 electrons. Comparison with the stochastic GW many-body perturbation technique indicates excellent agreement for the fundamental band gap energies, good agreement for the band edge quasiparticle excitations, and very low statistical errors in the total energy for large systems. The present approach has a major advantage over one-shot GW by providing a self-consistent Hamiltonian that is central for additional postprocessing, for example, in the stochastic Bethe–Salpeter approach.

Rabani, E. ; Baer, R. ; Neuhauser, D. Time-dependent stochastic Bethe-Salpeter approach. Phys. Rev. B 2015, 91, 235302.Abstract

A time-dependent formulation for electron-hole excitations in extended finite systems, based on the Bethe-Salpeter equation (BSE), is developed using a stochastic wave function approach. The time-dependent formulation builds on the connection between time-dependent Hartree-Fock (TDHF) theory and the configuration-interaction with single substitution (CIS) method. This results in a time-dependent Schrödinger-like equation for the quasiparticle orbital dynamics based on an effective Hamiltonian containing direct Hartree and screened exchange terms, where screening is described within the random-phase approximation (RPA). To solve for the optical-absorption spectrum, we develop a stochastic formulation in which the quasiparticle orbitals are replaced by stochastic orbitals to evaluate the direct and exchange terms in the Hamiltonian as well as the RPA screening. This leads to an overall quadratic scaling, a significant improvement over the equivalent symplectic eigenvalue representation of the BSE. Application of the time-dependent stochastic BSE (TDsBSE) approach to silicon and CdSe nanocrystals up to size of  3000 electrons is presented and discussed.

Jacobi, S. ; Baer, R. Smoothing and extrapolating shifted-contour auxiliary-field Monte Carlo signals using discrete Laguerre functions. arXiv preprint arXiv:1504.05452 2015.Abstract

We develop a new smoothing or extrapolating method, based on discrete Laguerre functions, for systematically analyzing the stochastic signal of shifted-contour auxiliary-field Monte Carlo. We study the statistical errors and extrapolation errors using full configuration-interaction energies for the doubly stretched water molecule. The only free parameter is the order N of the fit. We show that low N emphasizes stability while higher N enable improved extrapolation, at the cost of increased statistical errors. Typically, one should use low order for signals based on a small number of iterations while higher order is efficacious for signals based on large number of iterations. We provide a heuristic algorithm for determining the order to be used and show its utility.

Gao, Y. ; Neuhauser, D. ; Baer, R. ; Rabani, E. Sublinear scaling for time-dependent stochastic density functional theory. J. Chem. Phys. 2015, 142, 034106.Abstract

A stochastic approach to time-dependent density functional theory is developed for computing the absorption cross section and the random phase approximation (RPA) correlation energy. The core idea of the approach involves time-propagation of a small set of stochastic orbitals which are first projected on the occupied space and then propagated in time according to the time-dependent Kohn-Sham equations. The evolving electron density is exactly represented when the number of random orbitals is infinite, but even a small number ( 16) of such orbitals is enough to obtain meaningful results for absorption spectrum and the RPA correlation energy per electron. We implement the approach for silicon nanocrystals using real-space grids and find that the overall scaling of the algorithm is sublinear with computational time and memory.

Neuhauser, D. ; Gao, Y. ; Arntsen, C. ; Karshenas, C. ; Rabani, E. ; Baer, R. Breaking the Theoretical Scaling Limit for Predicting Quasiparticle Energies: The Stochastic GW Approach. Phys. Rev. Lett. 2014, 113, 076402.Abstract

We develop a formalism to calculate the quasiparticle energy within the GW many-body perturbation correction to the density functional theory. The occupied and virtual orbitals of the Kohn-Sham Hamiltonian are replaced by stochastic orbitals used to evaluate the Green function G, the polarization potential W, and, thereby, the GW self-energy. The stochastic GW (sGW) formalism relies on novel theoretical concepts such as stochastic time-dependent Hartree propagation, stochastic matrix compression, and spatial or temporal stochastic decoupling techniques. Beyond the theoretical interest, the formalism enables linear scaling GW calculations breaking the theoretical scaling limit for GW as well as circumventing the need for energy cutoff approximations. We illustrate the method for silicon nanocrystals of varying sizes with Ne > 3000 electrons.

Neuhauser, D. ; Baer, R. ; Rabani, E. Communication: Embedded fragment stochastic density functional theory. J. Chem. Phys. 2014, 141, 041102.Abstract

We develop a method in which the electronic densities of small fragments determined by Kohn-Sham density functional theory (DFT) are embedded using stochastic DFT to form the exact density of the full system. The new method preserves the scaling and the simplicity of the stochastic DFT but cures the slow convergence that occurs when weakly coupled subsystems are treated. It overcomes the spurious charge fluctuations that impair the applications of the original stochastic DFT approach. We demonstrate the new approach on a fullerene dimer and on clusters of water molecules and show that the density of states and the total energy can be accurately described with a relatively small number of stochastic orbitals.

Cytter, Y. ; Neuhauser, D. ; Baer, R. Metropolis Evaluation of the Hartree–Fock Exchange Energy. J. Chem. Theory Comput. 2014, 10, 4317–4323.Abstract

We examine the possibility of using a Metropolis algorithm for computing the exchange energy in a large molecular system. Following ideas set forth in a recent publication (Baer, Neuhauser, and Rabani, Phys. Rev. Lett. 111, 106402 (2013)) we focus on obtaining the exchange energy per particle (ExPE, as opposed to the total exchange energy) to a predefined statistical error and on determining the numerical scaling of the calculation achieving this. For this we assume that the occupied molecular orbitals (MOs) are known and given in terms of a standard Gaussian atomic basis set. The Metropolis random walk produces a sequence of pairs of three-dimensional points (x,x'), which are distributed in proportion to $\rho(x,x')^2$, where $\rho(x,x')$ is the density matrix. The exchange energy per particle is then simply the average of the Coulomb repulsion energy U_C(|x–x'|) over these pairs. To reduce the statistical error we separate the exchange energy into a short-range term that can be calculated deterministically in a linear scaling fashion and a long-range term that is treated by the Metropolis method. We demonstrate the method on water clusters and silicon nanocrystals showing the magnitude of the ExPE standard deviation is independent of system size. In the water clusters a longer random walk was necessary to obtain full ergodicity as Metropolis walkers tended to get stuck for a while in localized regions. We developed a diagnostic tool that can alert a user when such a situation occurs. The calculation effort scales linearly with system size if one uses an atom screening procedure that can be made numerically exact. In systems where the MOs can be localized efficiently the ExPE can even be computed with “sublinear scaling” as the MOs themselves can be screened.

Neuhauser, D. ; Rabani, E. ; Baer, R. Expeditious Stochastic Approach for MP2 Energies in Large Electronic Systems. J. Chem. Theory Comput. 2013, 9 24–27.Abstract

A fast stochastic method for calculating the second order Møller-Plesset (MP2) correction to the correlation energy of large systems of electrons is presented. The approach is based on reducing the exact summation over occupied and unoccupied states to a time-dependent trace formula amenable to stochastic sampling. We demonstrate the abilities of the method to treat systems with thousands of electrons using hydrogen passivated silicon spherical nanocrystals represented on a real space grid, much beyond the capabilities of present day MP2 implementations.

Neuhauser, D. ; Rabani, E. ; Baer, R. Expeditious Stochastic Calculation of Random-Phase Approximation Energies for Thousands of Electrons in Three Dimensions. J. Phys. Chem. Lett. 2013, 4 1172–1176.Abstract

A fast method is developed for calculating the random phase approximation (RPA) correlation energy for density functional theory. The correlation energy is given by a trace over a projected RPA response matrix, and the trace is taken by a stochastic approach using random perturbation vectors. For a fixed statistical error in the total energy per electron, the method scales, at most, quadratically with the system size; however, in practice, due to self-averaging, it requires less statistical sampling as the system grows, and the performance is close to linear scaling. We demonstrate the method by calculating the RPA correlation energy for cadmium selenide and silicon nanocrystals with over 1500 electrons. We find that the RPA correlation energies per electron are largely independent of the nanocrystal size. In addition, we show that a correlated sampling technique enables calculation of the energy difference between two slightly distorted configurations with scaling and a statistical error similar to that of the total energy per electron.

Ge, Q. ; Gao, Y. ; Baer, R. ; Rabani, E. ; Neuhauser, D. A Guided Stochastic Energy-Domain Formulation of the Second Order Møller–Plesset Perturbation Theory. J. Phys. Chem. Lett. 2013, 5 185–189.Abstract

We develop an alternative formulation in the energy-domain to calculate the second order Møller–Plesset (MP2) perturbation energies. The approach is based on repeatedly choosing four random energies using a nonseparable guiding function, filtering four random orbitals at these energies, and averaging the resulting Coulomb matrix elements to obtain a statistical estimate of the MP2 correlation energy. In contrast to our time-domain formulation, the present approach is useful for both quantum chemistry and real-space/plane wave basis sets. The scaling of the MP2 calculation is roughly linear with system size, providing a useful tool to study dispersion energies in large systems. This is demonstrated on a structure of 64 fullerenes within the SZ basis as well as on silicon nanocrystals using real-space grids.

Baer, R. ; Neuhauser, D. ; Rabani, E. Self-Averaging Stochastic Kohn-Sham Density-Functional Theory. Phys. Rev. Lett. 2013, 111, 106402. Publisher's VersionAbstract

We formulate the Kohn-Sham density functional theory (KS-DFT) as a statistical theory in which the electron density is determined from an average of correlated stochastic densities in a trace formula. The key idea is that it is sufficient to converge the total energy per electron to within a predefined statistical error in order to obtain reliable estimates of the electronic band structure, the forces on nuclei, the density and its moments, etc. The fluctuations in the total energy per electron are guaranteed to decay to zero as the system size increases. This facilitates “self-averaging” which leads to the first ever report of sublinear scaling KS-DFT electronic structure. The approach sidesteps calculation of the density matrix and thus, is insensitive to its evasive sparseness, as demonstrated here for silicon nanocrystals. The formalism is not only appealing in terms of its promise to far push the limits of application of KS-DFT, but also represents a cognitive change in the way we think of electronic structure calculations as this stochastic theory seamlessly converges to the thermodynamic limit.

Jacobi, S. ; Baer, R. Variational grand-canonical electronic structure of Li+ Li at 10,000 K with second-order perturbation theory corrections. Theor. Chem. Acc. 2012, 131, 1113.Abstract

An ab initio variational grand-canonical electronic structure mean-field method, based on the Gibbs–Peierls–Bogoliubov minimum principle for the Gibbs free energy, is applied to the di-lithium (Li+Li) system at temperatures around T \approx 10,000 K and electronic chemical potential of μ \approx -0.1Eh. The method is an extension of the Hartree–Fock approach to finite temperatures. We first study the Li2 molecule at a frozen inter-nuclear distance of R = 3 \AA as a function of temperature. The mean-field electronic structure changes smoothly as temperature increases, up to 104 K, where a sharp spontaneous spin-polarization emerges as the variational mean-field solution. Further increase in the temperature extinguishes this polarization. We analyze the mean-field behavior using a correlated single-site Hubbard model and show it arises from an attempt of the mean-field to mimic the polarization of the spin–spin correlation function of the exact solution. Next, we keep constant the temperature at 104 K and examine the electronic structure as a function of inter-nuclear distance R. At R = 3.7 \AA, a crossing between two free energy states occurs: One state is “spin-unpolarized” (becomes lower in energy when R \ge 3.7 \AA), while the other is “spin polarized”. This crossing causes near-discontinuous jumps in calculated properties of the system and is associated with using the noninteracting electron character of our mean-field approach. Such problems will likely plague FT-DFT calculations as well. We use second-order perturbation theory (PT2) to study effects of electron correlation on the potential of mean force between the two colliding Li atoms. We find that PT2 correlation free energy at  104 K is larger than at 0 K and tends to restore the spin-polarized state as the lowest free energy solution.

Baer, R. ; Neuhauser, D. Communication: Monte Carlo calculation of the exchange energy. J. Chem. Phys. 2012, 137, 051103–4.Abstract

In recent generalized Kohn-Sham (GKS) schemes for density functional theory (DFT) Hartree-Fock type exchange is important. In plane waves and grid approaches the high cost of exchange energy calculations makes these GKS considerably more expensive than Kohn-Sham DFT calculations. We develop a stochastic approach for speeding up the calculation of exchange for large systems. We show that stochastic error per particle does not grow and can even decrease with system size (at a given number of iterations). We discuss several alternative approaches and explain how these ideas can be included in the GKS framework.

Baer, R. ; Rabani, E. Expeditious stochastic calculation of multiexciton generation rates in semiconductor nanocrystals. Nano Lett. 2012, 12, 2123–2128.Abstract

A stochastic method is developed to calculate the multiexciton generation (MEG) rates in semiconductor nanocrystals (NCs). The numerical effort scales near-linearly with system size allowing the study of MEG rates up to diameters and exciton energies previously unattainable using atomistic calculations. Illustrations are given for CdSe NCs of sizes and energies relevant to current experimental setups, where direct methods require treatment of over 1011 states. The approach is not limited to the study of MEG and can be applied to calculate other correlated electronic processes.

Jacobi, S. ; Baer, R. The well-tempered auxiliary-field Monte Carlo. The Journal of chemical physics 2004, 120, 43–50.Abstract

The auxiliary-field Monte Carlo (AFMC) is a method for computing ground-state and excited-state energies and other properties of electrons in molecules. For a given basis set, AFMC is an approximation to full-configuration interaction and the accuracy is determined predominantly by an inverse temperature "\beta" parameter. A considerable amount of the dynamical correlation energy is recovered even at small values of \beta. Yet, nondynamical correlation energy is inefficiently treated by AFMC. This is because the statistical error grows with \beta, warranting increasing amount of Monte Carlo sampling. A recently introduced multideterminant variant of AFMC is studied, and the method can be tuned by balancing the sizes of the determinantal space and the \beta parameter with respect to a predefined target accuracy. The well tempered AFMC is considerably more efficient than a naive AFMC. We demonstrate the principles on dissociating hydrogen molecule and torsion of ethylene where we calculate the (unoptimized) torsional barrier and the vertical singlet-triplet

Baer, R. ; Neuhauser, D. Shifted Contour Auxiliary Field Monte Carlo. In Recent Advances in Quantum Monte Carlo Methods II; W.A. Lester Jr., S. R. ; Tanaka, S., Ed.; World Scientific: Singapore, 2002; Vol. 3, pp. 279. baer2002f.pdf