Stochastic Non-equilibrium Systems

Submitted
Chekroun, Mickaël D., Jeroen S.W. Lamb, Christian J. Pangerl, and Martin Rasmussen. Submitted. “Girsanov approach to slow parameterizing manifolds in the presence of noise”. arXiv version Abstract

This work investigates a three-dimensional slow-fast stochastic system with quadratic nonlinearity and additive noise, inspired by fluid dynamics.
The deterministic counterpart exhibits a periodic orbit and a slow manifold.
We demonstrate that, under specific parameter regimes, this deterministic slow manifold can serve as an approximate parameterization of the fast variable by the slow variables within the stochastic system.

Building upon this parameterization, we derive a two-dimensional reduced model, a stochastic Hopf normal form, that captures the essential dynamics of the original system. Both the original and the reduced systems possess ergodic invariant measures, characterizing their long-term behavior.

We quantify the discrepancy between the original system and its slow approximation by deriving error estimates involving the Wasserstein distance between the marginals of these invariant measures along the radial component. These error bounds are shown to be controlled by a parameterization defect, which measures the quality of the fast-slow variable parameterization.

A key technical innovation lies in the application of Girsanov's theorem to obtain these error estimates in the presence of oscillatory instabilities.  Furthermore, we extend our analysis to regimes exhibiting an "inverted" timescale separation, where the variable to be parameterized evolves on a slower timescale than the resolved variables. To address these more challenging scenarios, we introduce path-dependent coefficients in the parameterizing manifold, enabling the derivation of robust error bounds for the corresponding reduced model. Numerical simulations complement our theoretical findings, providing insights into the model's behavior and exploring parameter regimes beyond the scope of our analytical results.

 

2025
Chekroun, Mickaël D., Honghu Liu, and James C. McWilliams. 2025. “Non-Markovian Reduced Models to Unravel Transitions in Non-equilibrium Systems.” Journal of Physics A: Mathematical and Theoretical 58 (4): 045204. Publisher's version Abstract

This work proposes a general framework for analyzing noise-driven transitions in  spatially extended non-equilibrium systems and explains the emergence of coherent patterns beyond the instability onset. The framework relies on stochastic parameterization formulas to reduce the complexity of the original equations while preserving the essential dynamical effects of unresolved scales. The approach is flexible and operates for both Gaussian noise and non-Gaussian noise with jumps.

Our stochastic parameterization formulas offer two key advantages. First, they can approximate stochastic invariant manifolds when these manifolds exist. Second, even when such manifolds break down, our formulas can be adapted through a simple optimization of its constitutive parameters. This allows us to handle scenarios with weak time-scale separation where the system has undergone multiple transitions, resulting in large-amplitude solutions not captured by invariant manifolds or other time-scale separation methods.

The optimized stochastic parameterizations capture then how small-scale noise impacts larger scales through the system's nonlinear interactions. This effect is achieved by the very fabric of our parameterizations incorporating non-Markovian (memory-dependent) coefficients into the reduced equation. These coefficients account for the noise's past influence, not just its current value, using a finite memory length that is selected for optimal performance. The specific "memory" function, which determines how this past influence is weighted, depends on both the strength of the noise and how it interacts with the system's nonlinearities.

Remarkably, training our theory-guided reduced models on a single noise path effectively learns the optimal memory length for out-of-sample predictions. This approach retains indeed good accuracy in predicting noise-induced transitions, including rare events, when tested against a large ensemble of different noise paths. This success stems from our ``hybrid" approach, which combines analytical understanding with data-driven learning. This combination avoids a key limitation of purely data-driven methods: their struggle to generalize to unseen scenarios, also known as the "extrapolation problem."

 

 

 

Chekroun_al25_J_PhysA.pdf
2024
Detection and attribution (DA) studies are cornerstones of climate science, providing crucial evidence for policy decisions. Their goal is to link observed climate change patterns to anthropogenic and natural drivers via the optimal fingerprinting method (OFM). We show that response theory for nonequilibrium systems offers the physical and dynamical basis for OFM, including the concept of causality used for attribution. Our framework clarifies the method’s assumptions, advantages, and potential weaknesses. We use our theory to perform DA for prototypical climate change experiments performed on an energy balance model and on a low-resolution coupled climate model. We also explain the underpinnings of degenerate fingerprinting, which offers early warning indicators for tipping points. Finally, we extend the OFM to the nonlinear response regime. Our analysis shows that OFM has broad applicability across diverse stochastic systems influenced by time-dependent forcings, with potential relevance to ecosystems, quantitative social sciences, and finance, among others.
 
PRL_Hasselmann_Fingerprint.pdf
2023
Chekroun, Mickaël D., Honghu Liu, James C. McWilliams, and Shouhong Wang. 2023. “Transitions in Stochastic Non-equilibrium Systems: Efficient Reduction and Analysis.” Journal of Differential Equations 346 (10): 145-204. Publisher's version Abstract

A central challenge in physics is to describe non-equilibrium systems driven by randomness, such as a randomly growing interface, or fluids subject to random fluctuations that account e.g. for local stresses and heat fluxes in the fluid which are not related to the velocity and temperature gradients. For deterministic systems with infinitely many degrees of freedom, normal form and center manifold theory have shown a prodigious efficiency to often completely characterize how the onset of linear instability translates into the emergence of nonlinear patterns, associated with genuine physical regimes. However, in presence of random fluctuations, the underlying reduction principle to the center manifold is seriously challenged due to large excursions caused by the noise, and the approach needs to be revisited.

In this study, we present an alternative framework to cope with these difficulties exploiting the approximation theory of stochastic invariant manifolds, on one hand, and energy estimates measuring the defect of parameterization of the high-modes, on the other. To operate for fluid problems subject to stochastic stirring forces, these error estimates are derived under assumptions regarding dissipation effects brought by the high-modes in order to suitably counterbalance the loss of regularity due to the nonlinear terms. As a result, the approach enables us to analyze, from reduced equations of the stochastic fluid problem, the occurrence in large probability of a stochastic analogue to the pitchfork bifurcation, as long as the noise’s intensity and the eigenvalue’s magnitude of the mildly unstable mode scale accordingly.


In the case of SPDEs forced by a multiplicative noise in the orthogonal subspace of e.g. its mildly unstable mode, our parameterization formulas show that the noise gets transmitted to this mode via non-Markovian coefficients, and that the reduced equation is only stochastically driven by the latter.  These coefficients depend explicitly on the noise path's history, and their memory content is self-consistently determined by the intensity of the random force and its interaction through the SPDE's nonlinear terms. Applications to a stochastic Rayleigh-B\'enard problem  are detailed, for which conditions for a stochastic pitchfork bifurcation (in large probability) to occur, are clarified.

 

 

 

2022
Chekroun, Mickaël D., Ilan Koren, Honghu Liu, and Huan Liu. 2022. “Generic generation of noise-driven chaos in stochastic time delay systems: Bridging the gap with high-end simulations.” Science Advances 8 (46): eabq7137. Publisher's Version Abstract

Nonlinear time delay systems produce inherently delay-induced periodic oscillations, which are, however, too idealistic compared to observations. We exhibit a unified stochastic framework to systematically rectify such oscillations into oscillatory patterns with enriched temporal variabilities through generic, nonlinear responses to stochastic perturbations. Two paradigms of noise-driven chaos in high dimension are identified, fundamentally different from chaos triggered by parameter-space noise. Noteworthy is a low-dimensional stretch-and-fold mechanism, leading to stochastic strange attractors exhibiting horseshoe-like structures mirroring turbulent transport of passive tracers. The other is high-dimensional , with noise acting along the critical eigendirection and transmitted to deeperstable modes through nonlinearity, leading to stochastic attractors exhibiting swarm-like behaviors with power-law and scale break properties. The theory is applied to cloud delay models to parameterize missing physics such as intermittent rain and Lagrangian turbulent effects. The stochastically rectified model reproduces with fidelity complex temporal variabilities of open-cell oscillations exhibited by high-end cloud simulations.

2020
Tantet, Alexis, Mickaël D. Chekroun, Henk A. Dijkstra, and J. David Neelin. 2020. “Ruelle-Pollicott Resonances of Stochastic Systems in Reduced State Space. Part II: Stochastic Hopf Bifurcation.” Journal of Statistical Physics 179: 1403–1448. Publisher's Version Abstract

The spectrum of the generator (Kolmogorov operator) of a diffusion process, referred to as the Ruelle-Pollicott (RP) spectrum, provides a detailed characterization of correlation functions and power spectra of stochastic systems via decomposition formulas in terms of RP resonances; see Part I of this contribution (Chekroun et al. in Theory J Stat. https://doi.org/10.1007/s10955-020-02535-x, 2020). Stochastic analysis techniques relying on the theory of Markov semigroups for the study of the RP spectrum and a rigorous reduction method is presented in Part I Chekroun et al. (2020). This framework is here applied to study a stochastic Hopf bifurcation in view of characterizing the statistical properties of nonlinear oscillators perturbed by noise, depending on their stability. In light of the Hörmander theorem, it is first shown that the geometry of the unperturbed limit cycle, in particular its isochrons, i.e., the leaves of the stable manifold of the limit cycle generalizing the notion of phase, is essential to understand the effect of the noise and the phenomenon of phase diffusion. In addition, it is shown that the RP spectrum has a spectral gap, even at the bifurcation point, and that correlations decay exponentially fast. Explicit small-noise expansions of the RP eigenvalues and eigenfunctions are then obtained, away from the bifurcation point, based on the knowledge of the linearized deterministic dynamics and the characteristics of the noise. These formulas allow one to understand how the interaction of the noise with the deterministic dynamics affect the decay of correlations. Numerical results complement the study of the RP spectrum at the bifurcation point, revealing useful scaling laws. The analysis of the Markov semigroup for stochastic bifurcations is thus promising in providing a complementary approach to the more geometric random dynamical system (RDS) approach. This approach is not limited to low-dimensional systems and the reduction method presented in Chekroun et al. (2020) is applied to a stochastic model relevant to climate dynamics in the third part of this contribution (Tantet et al. in J Stat Phys. https://doi.org/10.1007/s10955-019-02444-8, 2019).

Chekroun, Mickaël D., A. Tantet, Henk A. Dijkstra, and J. David Neelin. 2020. “Ruelle-Pollicott Resonances of Stochastic Systems in Reduced State Space. Part I: Theory.” Journal of Statistical Physics 179: 1366–1402. Publisher's Version Abstract

A theory of Ruelle–Pollicott (RP) resonances for stochastic differential systems is presented. These resonances are defined as the eigenvalues of the generator (Kolmogorov operator) of a given stochastic system. By relying on the theory of Markov semigroups, decomposition formulas of correlation functions and power spectral densities (PSDs) in terms of RP resonances are then derived. These formulas describe, for a broad class of stochastic differential equations (SDEs), how the RP resonances characterize the decay of correlations as well as the signal’s oscillatory components manifested by peaks in the PSD. It is then shown that a notion reduced RP resonances can be rigorously defined, as soon as the dynamics is partially observed within a reduced state space V. These reduced resonances are obtained from the spectral elements of reduced Markov operators acting on functions of the state space V, and can be estimated from series. They inform us about the spectral elements of some coarse-grained version of the SDE generator. When the time-lag at which the transitions are collected from partial observations in V, is either sufficiently small or large, it is shown that the reduced RP resonances approximate the (weak) RP resonances of the generator of the conditional expectation in V, i.e. the optimal reduced system in V obtained by averaging out the contribution of the unobserved variables. The approach is illustrated on a stochastic slow-fast system for which it is shown that the reduced RP resonances allow for a good reconstruction of the correlation functions and PSDs, even when the time-scale separation is weak. The companions articles, Part II and Part III, deal with further practical aspects of the theory presented in this contribution. One important byproduct consists of the diagnosis usefulness of stochastic dynamics that RP resonances provide. This is illustrated in the case of a stochastic Hopf bifurcation in Part II. There, it is shown that such a bifurcation has a clear manifestation in terms of a geometric organization of the RP resonances along discrete parabolas in the left half plane. Such geometric features formed by (reduced) RP resonances are extractable from time series and allow thus for providing an unambiguous “signature” of nonlinear oscillations embedded within a stochastic background. By relying then on the theory of reduced RP resonances presented in this contribution, Part III addresses the question of detection and characterization of such oscillations in a high-dimensional stochastic system, namely the Cane–Zebiak model of El Niño-Southern Oscillation subject to noise modeling fast atmospheric fluctuations.

Tantet, Alexis, Mickaël D. Chekroun, J. David Neelin, and Henk A. Dijkstra. 2020. “Ruelle–Pollicott Resonances of Stochastic Systems in Reduced State Space. Part III: Application to the Cane–Zebiak Model of the El Niño–Southern Oscillation.” Journal of Statistical Physics 179: 1449–1474. Publisher's Version Abstract

The response of a low-frequency mode of climate variability, El Niño–Southern Oscillation, to stochastic forcing is studied in a high-dimensional model of intermediate complexity, the fully-coupled Cane–Zebiak model (Zebiak and Cane 1987), from the spectral analysis of Markov operators governing the decay of correlations and resonances in the power spectrum. Noise-induced oscillations excited before a supercritical Hopf bifurcation are examined by means of complex resonances, the reduced Ruelle–Pollicott (RP) resonances, via a numerical application of the reduction approach of the first part of this contribution (Chekroun et al. 2019) to model simulations. The oscillations manifest themselves as peaks in the power spectrum which are associated with RP resonances organized along parabolas, as the bifurcation is neared. These resonances and the associated eigenvectors are furthermore well described by the small-noise expansion formulas obtained by Gaspard (2002) and made explicit in the second part of this contribution (Tantet et al. 2019). Beyond the bifurcation, the spectral gap between the imaginary axis and the real part of the leading resonances quantifies the diffusion of phase of the noise-induced oscillations and can be computed from the linearization of the model and from the diffusion matrix of the noise. In this model, the phase diffusion coefficient thus gives a measure of the predictability of oscillatory events representing ENSO. ENSO events being known to be locked to the seasonal cycle, these results should be extended to the non-autonomous case. More generally, the reduction approach theorized in Chekroun et al. (2019), complemented by our understanding of the spectral properties of reference systems such as the stochastic Hopf bifurcation, provides a promising methodology for the analysis of low-frequency variability in high-dimensional stochastic systems.

2016
Chekroun, Mickaël D., Eunhee Park, and Roger Temam. 2016. “The Stampacchia maximum principle for stochastic partial differential equations and applications.” Journal of Differential Equations 260 (3): 2926 - 2972. Publisher's Version Abstract
Abstract Stochastic partial differential equations (SPDEs) are considered, linear and nonlinear, for which we establish comparison theorems for the solutions, or positivity results a.e., and a.s., for suitable data. Comparison theorems for \SPDEs\ are available in the literature. The originality of our approach is that it is based on the use of truncations, following the Stampacchia approach to maximum principle. We believe that our method, which does not rely too much on probability considerations, is simpler than the existing approaches and to a certain extent, more directly applicable to concrete situations. Among the applications, boundedness results and positivity results are respectively proved for the solutions of a stochastic Boussinesq temperature equation, and of reaction–diffusion equations perturbed by a non-Lipschitz nonlinear noise. Stabilization results to a Chafee–Infante equation perturbed by a nonlinear noise are also derived.
2015
Chekroun, Mickaël D., Honghu Liu, and Shouhong Wang. 2015. Approximation of Stochastic Invariant Manifolds : Stochastic Manifolds for Nonlinear SPDEs I. New York: Springer Briefs in Mathematics, Springer, pp. 127. Publisher's Version Abstract

This first volume is concerned with the analytic derivation of explicit formulas for the leading-order Taylor approximations of (local) stochastic invariant manifolds associated with a broad class of nonlinear stochastic partial differential equations. These approximations  take the form of Lyapunov-Perron integrals, which are further characterized in Volume II as pullback limits associated with some partially coupled backward-forward systems. This pullback characterization provides a useful interpretation of the corresponding approximating manifolds and leads to a simple framework that unifies some other approximation approaches in the literature. A self-contained survey is also included on the existence and attraction of one-parameter families of stochastic invariant manifolds, from the point of view of the theory of random dynamical systems.

Chekroun, Mickaël D., Honghu Liu, and Shouhong Wang. 2015. Stochastic Parameterizing Manifolds and Non-Markovian Reduced Equations : Stochastic Manifolds for Nonlinear SPDEs II. New York: Springer Briefs in Mathematics, Springer, pp. 129. Publisher's Version Abstract

In this second volume, a general approach is developed to provide approximate parameterizations of the "small" scales by the "large" ones for a broad class of stochastic partial differential equations (SPDEs). This is accomplished via the concept of parameterizing manifolds (PMs), which are stochastic manifolds that improve, for a given realization of the noise, in mean square error the partial knowledge of the full SPDE solution when compared to its projection onto some resolved modes. Backward-forward systems are designed to give access to such PMs in practice. The key idea consists of representing the modes with high wave numbers as a pullback limit depending on the time-history of the modes with low wave numbers. Non-Markovian stochastic reduced systems are then derived based on such a PM approach. The reduced systems take the form of stochastic differential equations involving random coefficients that convey memory effects. The theory is illustrated on a stochastic Burgers-type equation.