Modes of Variability

Submitted
We introduce a generalization of linear response theory for mixed jump-diffusion models, combining both Gaussian and Lévy noise forcings that interact with the nonlinear dynamics. This class of models covers a broad range of stochastic chaos and complexity for which the jump-diffusion processes are a powerful tool to parameterize the missing physics or effects of the unresolved scales onto the resolved ones.
By generalizing concepts such as Kolmogorov operators and Green's functions to this context, we derive fluctuation-dissipation relationships for such models. The system response can then be interpreted in terms of contributions from the eigenmodes of the Kolmogorov operator (Kolmogorov modes) decomposing the time-lagged correlation functions of the unperturbed dynamics. The underlying formulas offer a fresh look on the intimate relationships between the system's natural variability and its forced variability.
We apply our theory to a paradigmatic El Niño-Southern Oscillation (ENSO) subject to state-dependent jumps and additive white noise parameterizing intermittent and nonlinear feedback mechanisms, key factors in the actual ENSO phenomenon. Such stochastic parameterizations are shown to produce stochastic chaos with an enriched time-variability. The Kolmogorov modes encoding the latter are then computed, and our Green's functions formulas are shown to achieve a remarkable accuracy to predict the system's response to perturbations.
This work enriches Hasselmann's program by providing a more comprehensive approach to climate modeling and prediction, allowing for accounting the effects of both continuous and discontinuous stochastic forcing. Our results have implications for understanding climate sensitivity, detection and attributing climate change, and assessing the risk of climate tipping points.
Santos Gutiérrez, Manuel, and Mickaël D. Chekroun. Submitted. “The Optimal Growth Mode in the Relaxation to Statistical Equilibrium.” arXiv preprint, arXiv:2407.02545. arXiv version Abstract
Systems far from equilibrium approach stability slowly due to "anti-mixing" characterized by regions of the phase-space that remain disconnected after prolonged action of the flow. We introduce the Optimal Growth Mode (OGM) to capture this slow initial relaxation. The OGM is calculated from Markov matrices approximating the action of the Fokker-Planck operator onto the phase space. It is obtained as the mode having the largest growth in energy before decay. Important nuances between the OGM and the more traditional slowest decaying mode are detailed in the case of the Lorenz 63 model. The implications for understanding how complex systems respond to external forces, are discussed.
Lucarini, Valerio, and Mickaël D. Chekroun. Submitted. “Detecting and Attributing Change in Climate and Complex Systems: Foundations, Kolmogorov Modes, and Nonlinear Fingerprints.” arXiv preprint, arXiv:2212.02628. arXiv version Abstract
 
 
Detection and attribution studies have played a major role in shaping contemporary climate science and have provided key motivations supporting global climate policy negotiations. Their goal is to associate unambiguously observed patterns of climate change with anthropogenic and natural forcings acting as drivers through the so-called optimal fingerprinting method. We show here how response theory for nonequilibrium systems provides the physical and dynamical foundations behind optimal fingerprinting for the climate change detection and attribution problem, including the notion of causality used for attribution purposes. We clearly frame assumptions, strengths, and potential pitfalls of the method. Additionally, we clarify the mathematical framework behind the degenerate fingerprinting method that leads to early warning indicators for tipping points. Finally, we extend the optimal fingerprinting method to the regime of nonlinear response. Our findings indicate that optimal fingerprinting for detection and attribution can be applied to virtually any stochastic system undergoing time-dependent forcing.
2023
Lucarini, Valerio, and Mickaël D. Chekroun. 2023. “Theoretical tools for understanding the climate crisis from Hasselmann’s programme and beyond.” Nature Review Physics 5: 744-765 . Publisher's link Abstract
Klaus Hasselmann’s revolutionary intuition in climate science was to use the stochasticity associated with fast weather processes to probe the slow dynamics of the climate system. Doing so led to fundamentally new ways to study the response of climate models to perturbations, and to perform detection and attribution for climate change signals. Hasselmann’s programme has been extremely influential in climate science and beyond. In this Perspective, we first summarize the main aspects of such a programme using modern concepts and tools of statistical physics and applied mathematics. We then provide an overview of some promising scientific perspectives that might clarify the science behind the climate crisis and that stem from Hasselmann’s ideas. We show how to perform rigorous and data-driven model reduction by constructing parameterizations in systems that do not necessarily feature a timescale separation between unresolved and resolved processes. We outline a general theoretical framework for explaining the relationship between climate variability and climate change, and for performing climate change projections. This framework enables us seamlessly to explain some key general aspects of climatic tipping points. Finally, we show that response theory provides a solid framework supporting optimal fingerprinting methods for detection and attribution.
2020
Tantet, Alexis, Mickaël D. Chekroun, Henk A. Dijkstra, and J. David Neelin. 2020. “Ruelle-Pollicott Resonances of Stochastic Systems in Reduced State Space. Part II: Stochastic Hopf Bifurcation.” Journal of Statistical Physics 179: 1403–1448. Publisher's Version Abstract

The spectrum of the generator (Kolmogorov operator) of a diffusion process, referred to as the Ruelle-Pollicott (RP) spectrum, provides a detailed characterization of correlation functions and power spectra of stochastic systems via decomposition formulas in terms of RP resonances; see Part I of this contribution (Chekroun et al. in Theory J Stat. https://doi.org/10.1007/s10955-020-02535-x, 2020). Stochastic analysis techniques relying on the theory of Markov semigroups for the study of the RP spectrum and a rigorous reduction method is presented in Part I Chekroun et al. (2020). This framework is here applied to study a stochastic Hopf bifurcation in view of characterizing the statistical properties of nonlinear oscillators perturbed by noise, depending on their stability. In light of the Hörmander theorem, it is first shown that the geometry of the unperturbed limit cycle, in particular its isochrons, i.e., the leaves of the stable manifold of the limit cycle generalizing the notion of phase, is essential to understand the effect of the noise and the phenomenon of phase diffusion. In addition, it is shown that the RP spectrum has a spectral gap, even at the bifurcation point, and that correlations decay exponentially fast. Explicit small-noise expansions of the RP eigenvalues and eigenfunctions are then obtained, away from the bifurcation point, based on the knowledge of the linearized deterministic dynamics and the characteristics of the noise. These formulas allow one to understand how the interaction of the noise with the deterministic dynamics affect the decay of correlations. Numerical results complement the study of the RP spectrum at the bifurcation point, revealing useful scaling laws. The analysis of the Markov semigroup for stochastic bifurcations is thus promising in providing a complementary approach to the more geometric random dynamical system (RDS) approach. This approach is not limited to low-dimensional systems and the reduction method presented in Chekroun et al. (2020) is applied to a stochastic model relevant to climate dynamics in the third part of this contribution (Tantet et al. in J Stat Phys. https://doi.org/10.1007/s10955-019-02444-8, 2019).

Chekroun, Mickaël D., A. Tantet, Henk A. Dijkstra, and J. David Neelin. 2020. “Ruelle-Pollicott Resonances of Stochastic Systems in Reduced State Space. Part I: Theory.” Journal of Statistical Physics 179: 1366–1402. Publisher's Version Abstract

A theory of Ruelle–Pollicott (RP) resonances for stochastic differential systems is presented. These resonances are defined as the eigenvalues of the generator (Kolmogorov operator) of a given stochastic system. By relying on the theory of Markov semigroups, decomposition formulas of correlation functions and power spectral densities (PSDs) in terms of RP resonances are then derived. These formulas describe, for a broad class of stochastic differential equations (SDEs), how the RP resonances characterize the decay of correlations as well as the signal’s oscillatory components manifested by peaks in the PSD. It is then shown that a notion reduced RP resonances can be rigorously defined, as soon as the dynamics is partially observed within a reduced state space V. These reduced resonances are obtained from the spectral elements of reduced Markov operators acting on functions of the state space V, and can be estimated from series. They inform us about the spectral elements of some coarse-grained version of the SDE generator. When the time-lag at which the transitions are collected from partial observations in V, is either sufficiently small or large, it is shown that the reduced RP resonances approximate the (weak) RP resonances of the generator of the conditional expectation in V, i.e. the optimal reduced system in V obtained by averaging out the contribution of the unobserved variables. The approach is illustrated on a stochastic slow-fast system for which it is shown that the reduced RP resonances allow for a good reconstruction of the correlation functions and PSDs, even when the time-scale separation is weak. The companions articles, Part II and Part III, deal with further practical aspects of the theory presented in this contribution. One important byproduct consists of the diagnosis usefulness of stochastic dynamics that RP resonances provide. This is illustrated in the case of a stochastic Hopf bifurcation in Part II. There, it is shown that such a bifurcation has a clear manifestation in terms of a geometric organization of the RP resonances along discrete parabolas in the left half plane. Such geometric features formed by (reduced) RP resonances are extractable from time series and allow thus for providing an unambiguous “signature” of nonlinear oscillations embedded within a stochastic background. By relying then on the theory of reduced RP resonances presented in this contribution, Part III addresses the question of detection and characterization of such oscillations in a high-dimensional stochastic system, namely the Cane–Zebiak model of El Niño-Southern Oscillation subject to noise modeling fast atmospheric fluctuations.

2018
Kondrashov, Dmitri, Mickaël D. Chekroun, and Michael Ghil. 2018. “Data-adaptive harmonic decomposition and prediction of Arctic sea ice extent.” Dynamics and Statistics of the Climate System 3 (1): 1. Publisher's Version Abstract

Decline in the Arctic sea ice extent (SIE) is an area of active scientific research with profound socio-economic implications. Of particular interest are reliable methods for SIE forecasting on subseasonal time scales, in particular from early summer into fall, when sea ice coverage in the Arctic reaches its minimum. Here, we apply the recent data-adaptive harmonic (DAH) technique of Chekroun and Kondrashov, (2017), Chaos, 27 for the description, modeling and prediction of the Multisensor Analyzed Sea Ice Extent (MASIE, 2006–2016) data set. The DAH decomposition of MASIE identifies narrowband, spatio-temporal data-adaptive modes over four key Arctic regions. The time evolution of the DAH coefficients of these modes can be modelled and predicted by using a set of coupled Stuart–Landau stochastic differential equations that capture the modes’ frequencies and amplitude modulation in time. Retrospective forecasts show that our resulting multilayer Stuart–Landau model (MSLM) is quite skilful in predicting September SIE compared to year-to-year persistence; moreover, the DAH–MSLM approach provided accurate real-time prediction that was highly competitive for the 2016–2017 Sea Ice Outlook.

Kondrashov, Dmitri, Mickaël D. Chekroun, and Pavel Berloff. 2018. “Multiscale Stuart-Landau Emulators: Application to Wind-Driven Ocean Gyres.” Fluids 3 (1): 21. Publisher's Version Abstract

The multiscale variability of the ocean circulation due to its nonlinear dynamics remains a big challenge for theoretical understanding and practical ocean modeling. This paper demonstrates how the data-adaptive harmonic (DAH) decomposition and inverse stochastic modeling techniques introduced in (Chekroun and Kondrashov, (2017), Chaos, 27), allow for reproducing with high fidelity the main statistical properties of multiscale variability in a coarse-grained eddy-resolving ocean flow. This fully-data-driven approach relies on extraction of frequency-ranked time-dependent coefficients describing the evolution of spatio-temporal DAH modes (DAHMs) in the oceanic flow data. In turn, the time series of these coefficients are efficiently modeled by a family of low-order stochastic differential equations (SDEs) stacked per frequency, involving a fixed set of predictor functions and a small number of model coefficients. These SDEs take the form of stochastic oscillators, identified as multilayer Stuart–Landau models (MSLMs), and their use is justified by relying on the theory of Ruelle–Pollicott resonances. The good modeling skills shown by the resulting DAH-MSLM emulators demonstrates the feasibility of using a network of stochastic oscillators for the modeling of geophysical turbulence. In a certain sense, the original quasiperiodic Landau view of turbulence, with the amendment of the inclusion of stochasticity, may be well suited to describe turbulence.

Decadal DAH mode

 

Kondrashov, Dmitri, Mickaël D. Chekroun, Xiaojun Yuan, and Michael Ghil. 2018. “Data-adaptive harmonic decomposition and stochastic modeling of Arctic sea ice.” Advances in Nonlinear Geosciences, A. Tsonis, 179-205. Springer. Publisher's Version Abstract

We present and apply a novel method of describing and modeling complex multivariate datasets in the geosciences and elsewhere. Data-adaptive harmonic (DAH) decomposition identifies narrow-banded, spatio-temporal modes (DAHMs) whose frequencies are not necessarily integer multiples of each other. The evolution in time of the DAH coefficients (DAHCs) of these modes can be modeled using a set of coupled Stuart-Landau stochastic differential equations that capture the modes’ frequencies and amplitude modulation in time and space. This methodology is applied first to a challenging synthetic dataset and then to Arctic sea ice concentration (SIC) data from the US National Snow and Ice Data Center (NSIDC). The 36-year (1979–2014) dataset is parsimoniously and accurately described by our DAHMs. Preliminary results indicate that simulations using our multilayer Stuart-Landau model (MSLM) of SICs are stable for much longer time intervals, beyond the end of the twenty-first century, and exhibit interdecadal variability consistent with past historical records. Preliminary results indicate that this MSLM is quite skillful in predicting September sea ice extent.

2017
Chekroun, Mickaël D., and Dmitri Kondrashov. 2017. “Data-adaptive harmonic spectra and multilayer Stuart-Landau models.” Chaos: An Interdisciplinary Journal of Nonlinear Science 27 (9): 093110. Publisher's version Abstract

Harmonic decompositions of multivariate time series are considered for which we adopt an integral operator approach with  
periodic semigroup kernels. Spectral decomposition theorems are derived that cover the important cases of two-time statistics drawn from a mixing invariant measure. 

The corresponding eigenvalues can be grouped per Fourier frequency, and are actually given, at each frequency, as the singular values of a cross-spectral matrix depending on the data. These eigenvalues obey furthermore a variational principle that allows us to define naturally a multidimensional power spectrum.  The eigenmodes, as far as they are concerned, exhibit a data-adaptive character manifested in their phase which allows us in turn to define a multidimensional phase spectrum.

The resulting data-adaptive harmonic (DAH) modes allow for reducing the data-driven modeling effort to elemental models stacked per frequency, only coupled at different frequencies by the same noise realization. In particular, the DAH decomposition extracts time-dependent coefficients stacked by Fourier frequency which can be efficiently modeled---provided the decay of temporal correlations is sufficiently well-resolved---within a class of multilayer stochastic models (MSMs) tailored here on stochastic Stuart-Landau oscillators.

Applications to the Lorenz 96 model and to a stochastic heat equation driven by a space-time white noise, are considered. In both cases, the DAH decomposition allows for an extraction of spatio-temporal modes revealing key features of the dynamics in the embedded phase space. The multilayer Stuart-Landau models (MSLMs) are shown to successfully model the typical patterns of the corresponding time-evolving fields, as well as their statistics of occurrence.

2014
Chekroun, M. D., J. D. Neelin, D. Kondrashov, J. C. McWilliams, and M. Ghil. 2014. “Rough parameter dependence in climate models and the role of Ruelle-Pollicott resonance.” Proceeding of the National Academy of Sciences 111 (5): 1684—1690. Publisher's Version Abstract

Despite the importance of uncertainties encountered in climate model simulations, the fundamental mechanisms at the origin of sensitive behavior of long-term model statistics remain unclear. Variability of turbulent flows in the atmosphere and oceans exhibits recurrent large-scale patterns. These patterns, while evolving irregularly in time, manifest characteristic frequencies across a large range of time scales, from intraseasonal through interdecadal. Based on modern spectral theory of chaotic and dissipative dynamical systems, the associated low-frequency variability may be formulated in terms of Ruelle-Pollicott (RP) resonances. RP resonances encode information on the nonlinear dynamics of the system, and an approach for estimating them—as filtered through an observable of the system—is proposed. This approach relies on an appropriate Markov representation of the dynamics associated with a given observable. It is shown that, within this representation, the spectral gap—defined as the distance between the subdominant RP resonance and the unit circle—plays a major role in the roughness of parameter dependences. The model statistics are the most sensitive for the smallest spectral gaps; such small gaps turn out to correspond to regimes where the low-frequency variability is more pronounced, whereas autocorrelations decay more slowly. The present approach is applied to analyze the rough parameter dependence encountered in key statistics of an El-Niño–Southern Oscillation model of intermediate complexity. Theoretical arguments, however, strongly suggest that such links between model sensitivity and the decay of correlation properties are not limited to this particular model and could hold much more generally.