Stochastic Non-equilibrium Systems

Submitted
Chekroun, Mickaël D., Honghu Liu, and James C. McWilliams. Submitted. “Non-Markovian Reduced Models to Unravel Transitions in Non-equilibrium Systems.” arXiv preprint, arXiv:2408.13428. arXiv version Abstract

This work proposes a general framework for analyzing noise-driven transitions in  spatially extended non-equilibrium systems and explains the emergence of coherent patterns beyond the instability onset. The framework relies on stochastic parameterization formulas to reduce the complexity of the original equations while preserving the essential dynamical effects of unresolved scales. The approach is flexible and operates for both Gaussian noise and non-Gaussian noise with jumps.

Our stochastic parameterization formulas offer two key advantages. First, they can approximate stochastic invariant manifolds when these manifolds exist. Second, even when such manifolds break down, our formulas can be adapted through a simple optimization of its constitutive parameters. This allows us to handle scenarios with weak time-scale separation where the system has undergone multiple transitions, resulting in large-amplitude solutions not captured by invariant manifolds or other time-scale separation methods.

The optimized stochastic parameterizations capture then how small-scale noise impacts larger scales through the system's nonlinear interactions. This effect is achieved by the very fabric of our parameterizations incorporating non-Markovian (memory-dependent) coefficients into the reduced equation. These coefficients account for the noise's past influence, not just its current value, using a finite memory length that is selected for optimal performance. The specific "memory" function, which determines how this past influence is weighted, depends on both the strength of the noise and how it interacts with the system's nonlinearities.

Remarkably, training our theory-guided reduced models on a single noise path effectively learns the optimal memory length for out-of-sample predictions. This approach retains indeed good accuracy in predicting noise-induced transitions, including rare events, when tested against a large ensemble of different noise paths. This success stems from our ``hybrid" approach, which combines analytical understanding with data-driven learning. This combination avoids a key limitation of purely data-driven methods: their struggle to generalize to unseen scenarios, also known as the "extrapolation problem."
 

 

2023
Chekroun, Mickaël D., Honghu Liu, James C. McWilliams, and Shouhong Wang. 2023. “Transitions in Stochastic Non-equilibrium Systems: Efficient Reduction and Analysis.” Journal of Differential Equations 346 (10): 145-204. Publisher's version Abstract

A central challenge in physics is to describe non-equilibrium systems driven by randomness, such as a randomly growing interface, or fluids subject to random fluctuations that account e.g. for local stresses and heat fluxes in the fluid which are not related to the velocity and temperature gradients. For deterministic systems with infinitely many degrees of freedom, normal form and center manifold theory have shown a prodigious efficiency to often completely characterize how the onset of linear instability translates into the emergence of nonlinear patterns, associated with genuine physical regimes. However, in presence of random fluctuations, the underlying reduction principle to the center manifold is seriously challenged due to large excursions caused by the noise, and the approach needs to be revisited.

In this study, we present an alternative framework to cope with these difficulties exploiting the approximation theory of stochastic invariant manifolds, on one hand, and energy estimates measuring the defect of parameterization of the high-modes, on the other. To operate for fluid problems subject to stochastic stirring forces, these error estimates are derived under assumptions regarding dissipation effects brought by the high-modes in order to suitably counterbalance the loss of regularity due to the nonlinear terms. As a result, the approach enables us to analyze, from reduced equations of the stochastic fluid problem, the occurrence in large probability of a stochastic analogue to the pitchfork bifurcation, as long as the noise’s intensity and the eigenvalue’s magnitude of the mildly unstable mode scale accordingly.


In the case of SPDEs forced by a multiplicative noise in the orthogonal subspace of e.g. its mildly unstable mode, our parameterization formulas show that the noise gets transmitted to this mode via non-Markovian coefficients, and that the reduced equation is only stochastically driven by the latter.  These coefficients depend explicitly on the noise path's history, and their memory content is self-consistently determined by the intensity of the random force and its interaction through the SPDE's nonlinear terms. Applications to a stochastic Rayleigh-B\'enard problem  are detailed, for which conditions for a stochastic pitchfork bifurcation (in large probability) to occur, are clarified.

 

 

 

2022
Chekroun, Mickaël D., Ilan Koren, Honghu Liu, and Huan Liu. 2022. “Generic generation of noise-driven chaos in stochastic time delay systems: Bridging the gap with high-end simulations.” Science Advances 8 (46): eabq7137. Publisher's Version Abstract

Nonlinear time delay systems produce inherently delay-induced periodic oscillations, which are, however, too idealistic compared to observations. We exhibit a unified stochastic framework to systematically rectify such oscillations into oscillatory patterns with enriched temporal variabilities through generic, nonlinear responses to stochastic perturbations. Two paradigms of noise-driven chaos in high dimension are identified, fundamentally different from chaos triggered by parameter-space noise. Noteworthy is a low-dimensional stretch-and-fold mechanism, leading to stochastic strange attractors exhibiting horseshoe-like structures mirroring turbulent transport of passive tracers. The other is high-dimensional , with noise acting along the critical eigendirection and transmitted to deeperstable modes through nonlinearity, leading to stochastic attractors exhibiting swarm-like behaviors with power-law and scale break properties. The theory is applied to cloud delay models to parameterize missing physics such as intermittent rain and Lagrangian turbulent effects. The stochastically rectified model reproduces with fidelity complex temporal variabilities of open-cell oscillations exhibited by high-end cloud simulations.

2020
Tantet, Alexis, Mickaël D. Chekroun, J. David Neelin, and Henk A. Dijkstra. 2020. “Ruelle–Pollicott Resonances of Stochastic Systems in Reduced State Space. Part III: Application to the Cane–Zebiak Model of the El Niño–Southern Oscillation.” Journal of Statistical Physics 179: 1449–1474. Publisher's Version Abstract

The response of a low-frequency mode of climate variability, El Niño–Southern Oscillation, to stochastic forcing is studied in a high-dimensional model of intermediate complexity, the fully-coupled Cane–Zebiak model (Zebiak and Cane 1987), from the spectral analysis of Markov operators governing the decay of correlations and resonances in the power spectrum. Noise-induced oscillations excited before a supercritical Hopf bifurcation are examined by means of complex resonances, the reduced Ruelle–Pollicott (RP) resonances, via a numerical application of the reduction approach of the first part of this contribution (Chekroun et al. 2019) to model simulations. The oscillations manifest themselves as peaks in the power spectrum which are associated with RP resonances organized along parabolas, as the bifurcation is neared. These resonances and the associated eigenvectors are furthermore well described by the small-noise expansion formulas obtained by Gaspard (2002) and made explicit in the second part of this contribution (Tantet et al. 2019). Beyond the bifurcation, the spectral gap between the imaginary axis and the real part of the leading resonances quantifies the diffusion of phase of the noise-induced oscillations and can be computed from the linearization of the model and from the diffusion matrix of the noise. In this model, the phase diffusion coefficient thus gives a measure of the predictability of oscillatory events representing ENSO. ENSO events being known to be locked to the seasonal cycle, these results should be extended to the non-autonomous case. More generally, the reduction approach theorized in Chekroun et al. (2019), complemented by our understanding of the spectral properties of reference systems such as the stochastic Hopf bifurcation, provides a promising methodology for the analysis of low-frequency variability in high-dimensional stochastic systems.

2016
Chekroun, Mickaël D., Eunhee Park, and Roger Temam. 2016. “The Stampacchia maximum principle for stochastic partial differential equations and applications.” Journal of Differential Equations 260 (3): 2926 - 2972. Publisher's Version Abstract
Abstract Stochastic partial differential equations (SPDEs) are considered, linear and nonlinear, for which we establish comparison theorems for the solutions, or positivity results a.e., and a.s., for suitable data. Comparison theorems for \SPDEs\ are available in the literature. The originality of our approach is that it is based on the use of truncations, following the Stampacchia approach to maximum principle. We believe that our method, which does not rely too much on probability considerations, is simpler than the existing approaches and to a certain extent, more directly applicable to concrete situations. Among the applications, boundedness results and positivity results are respectively proved for the solutions of a stochastic Boussinesq temperature equation, and of reaction–diffusion equations perturbed by a non-Lipschitz nonlinear noise. Stabilization results to a Chafee–Infante equation perturbed by a nonlinear noise are also derived.
2015
Chekroun, Mickaël D., Honghu Liu, and Shouhong Wang. 2015. Approximation of Stochastic Invariant Manifolds : Stochastic Manifolds for Nonlinear SPDEs I. New York: Springer Briefs in Mathematics, Springer, pp. 127. Publisher's Version Abstract

This first volume is concerned with the analytic derivation of explicit formulas for the leading-order Taylor approximations of (local) stochastic invariant manifolds associated with a broad class of nonlinear stochastic partial differential equations. These approximations  take the form of Lyapunov-Perron integrals, which are further characterized in Volume II as pullback limits associated with some partially coupled backward-forward systems. This pullback characterization provides a useful interpretation of the corresponding approximating manifolds and leads to a simple framework that unifies some other approximation approaches in the literature. A self-contained survey is also included on the existence and attraction of one-parameter families of stochastic invariant manifolds, from the point of view of the theory of random dynamical systems.

Chekroun, Mickaël D., Honghu Liu, and Shouhong Wang. 2015. Stochastic Parameterizing Manifolds and Non-Markovian Reduced Equations : Stochastic Manifolds for Nonlinear SPDEs II. New York: Springer Briefs in Mathematics, Springer, pp. 129. Publisher's Version Abstract

In this second volume, a general approach is developed to provide approximate parameterizations of the "small" scales by the "large" ones for a broad class of stochastic partial differential equations (SPDEs). This is accomplished via the concept of parameterizing manifolds (PMs), which are stochastic manifolds that improve, for a given realization of the noise, in mean square error the partial knowledge of the full SPDE solution when compared to its projection onto some resolved modes. Backward-forward systems are designed to give access to such PMs in practice. The key idea consists of representing the modes with high wave numbers as a pullback limit depending on the time-history of the modes with low wave numbers. Non-Markovian stochastic reduced systems are then derived based on such a PM approach. The reduced systems take the form of stochastic differential equations involving random coefficients that convey memory effects. The theory is illustrated on a stochastic Burgers-type equation.