Publications

46) Latency correction in sparse neuronal spike trains

Kreuz T, Senocrate F, Cecchini G, Checcucci C, Allegra Mascaro AL, Conti E, Scaglione A, Pavone FS,

J Neurosci Methods and arXiv [PDF] (2022) [PDF]

Background: In neurophysiological data, latency refers to a global shift of spikes from one spike train to the next, either caused

by response onset fluctuations or by finite propagation speed. Such systematic shifts in spike timing lead to a spurious decrease in

synchrony which needs to be corrected.


New Method: We propose a new algorithm of multivariate latency correction suitable for sparse data for which the relevant information

is not primarily in the rate but in the timing of each individual spike. The algorithm is designed to correct systematic delays

while maintaining all other kinds of noisy disturbances. It consists of two steps, spike matching and distance minimization between

the matched spikes using simulated annealing.


Results: We show its e ectiveness on simulated and real data: cortical propagation patterns recorded via calcium imaging from

mice before and after stroke. Using simulations of these data we also establish criteria that can be evaluated beforehand in order to

anticipate whether our algorithm is likely to yield a considerable improvement for a given dataset.


Comparison with existing Method(s): Existing methods of latency correction rely on adjusting peaks in rate profiles, an approach

that is not feasible for spike trains with low firing in which the timing of individual spikes contains essential information.


Conclusions: For any given dataset the criterion for applicability of the algorithm can be evaluated quickly and in case of a positive

outcome the latency correction can be applied easily since the source codes of the algorithm are publicly available.

Cecchini G, Scaglione A, Allegra Mascaro AL, Checcucci C, Conti E, Adam I, Fanelli D, Livi R, Pavone FS, Kreuz T

PLoS Comput Biol 17: e1008963 and bioRxiv [PDF] (2021) [PDF]

Stroke is a debilitating condition affecting millions of people worldwide. The development of improved rehabilitation therapies rests on finding biomarkers suitable for tracking functional damage and recovery. To achieve this goal, we perform a spatiotemporal analysis of cortical activity obtained by wide-field calcium images in mice before and after stroke. We compare spontaneous recovery with three different post-stroke rehabilitation paradigms, motor train- ing alone, pharmacological contralesional inactivation and both combined. We identify three novel indicators that are able to track how movement-evoked global activation patterns are impaired by stroke and evolve during rehabilitation: the duration, the smoothness, and the angle of individual propagation events. Results show that, compared to pre-stroke conditions, propagation of cortical activity in the subacute phase right after stroke is slowed down and more irregular. When comparing rehabilitation paradigms, we find that mice treated with both motor training and pharmacological intervention, the only group associated with generalized recovery, manifest new propagation patterns, that are even faster and smoother than before the stroke. In conclusion, our new spatiotemporal propagation indicators could represent promising biomarkers that are able to uncover neural correlates not only of motor deficits caused by stroke but also of functional recovery during rehabilitation. In turn, these insights could pave the way towards more targeted post-stroke therapies.

After COVID-19 was first reported in China at the end of 2019, it took only a few months for this local crisis to turn into a global pandemic with unprecedented disruptions of everyday life. However, at any moment in time the situation in different parts of the world is far from uniform and each country follows its own epidemiological trajectory. In order to keep track of the course of the pandemic in many different places at the same time, it is vital to develop comparative visualizations that facilitate the recognition of common trends and divergent behaviors. Similarly, it is important to always focus on the information that is most relevant at any given point in time. In this study we look at exactly one year of daily numbers of new cases and deaths and present data visualizations that compare many different countries and are adapted to the overall stage of the pandemic. During the early stage when cases and deaths still rise we focus on the time lag relative to the current epicenter of the pandemic and the doubling times. Later we monitor the rise and fall of the daily numbers via wave detection plots. The transition between these two stages takes place when the daily numbers stop rising for the first time.

Adam I, Cecchini G, Fanelli D, Kreuz T, Livi R, di Volo M, Allegra Mascaro AL, Conti E, Scaglione A, Silvestri L, Pavone FS

Chaos Solitons Fractals 140, 110235 and arXiv [PDF] (2020) [PDF]

An inverse procedure is proposed and tested which aims at recovering the a priori unknown functional and structural information from global signals of living brains activity. To this end, we consider a Leaky-Integrate and Fire (LIF) model with short term plasticity neurons, coupled via a directed network. Neurons are assigned a specific current value, which is heterogenous across the sample, and sets the firing regime in which the neuron is operating in. The aim of the method is to recover the distribution of incoming network degrees, as well as the distribution of the assigned currents, from global field measurements. The proposed approach to the inverse problem implements the reductionist Heterogenous Mean-Field approximation. This amounts in turn to organizing the neurons in different classes, depending on their associated degree and current. When tested against synthetic data, the method returns accurate estimates of the sought distributions, while managing to reproduce and interpolate almost exactly the time series of the supplied global field. Finally, we also applied the proposed technique to longitudinal wide-field fluorescence microscopy data of cortical functionality in awake Thy1-GCaMP6f mice. Mice are induced a photothrombotic stroke in the primary motor cortex and their recovery monitored in time. An all-to-all LIF model which accommodates for currents heterogeneity allows to adequately explain the recorded patterns of activation. Altered distributions in neuron excitability are in particular detected, compatible with the phenomenon of hyperexcitability in the penumbra region after stroke.

Kreuz T, Houghton C, Victor JD

Encycl Comp Neurosci, doi.org/10.1007/978-1-4614-7320-6_409-2 (2019) [PDF]

A “spike train distance” is a means for comparing two sequences of stereotyped events. The term “spike metric” refers to a spike train distance

that, additionally, has the formal mathematical properties of a metric. Spike train distances have broad application in neuroscience, since the action

potentials emitted by a neuron or set of neurons can be regarded as a sequence of stereotyped events; we briefly survey these applications here.

Satuvuori E, Mulansky M, Daffertshofer A, Kreuz T

JNeurosci Methods 308, 354 and arXiv [PDF] (2018) [PDF]

Background

Spike trains of multiple neurons can be analyzed following the summed population (SP) or the labeled line (LL) hypothesis. Responses to external stimuli are generated by a neuronal population as a whole or the individual neurons have encoding capacities of their own. The SPIKE-distance estimated either for a single, pooled spike train over a population or for each neuron separately can serve to quantify these responses.

New method

For the SP case we compare three algorithms that search for the most discriminative subpopulation over all stimulus pairs. For the LL case we introduce a new algorithm that combines neurons that individually separate different pairs of stimuli best.

Results

The best approach for SP is a brute force search over all possible subpopulations. However, it is only feasible for small populations. For more realistic settings, simulated annealing clearly outperforms gradient algorithms with only a limited increase in computational load. Our novel LL approach can handle very involved coding scenarios despite its computational ease.

Comparison with existing methods

Spike train distances have been extended to the analysis of neural populations interpolating between SP and LL coding. This includes parametrizing the importance of distinguishing spikes being fired in different neurons. Yet, these approaches only consider the population as a whole. The explicit focus on subpopulations render our algorithms complimentary.

Conclusions

The spectrum of encoding possibilities in neural populations is broad. The SP and LL cases are two extremes for which our algorithms provide correct identification results.

Satuvuori E, Kreuz T

JNeurosci Methods 299, 22 and arXiv [PDF] (2018) [PDF]

Background: It is commonly assumed in neuronal coding that repeated presentations of a stimulus to a coding neuron elicit similar responses. One common way to assess similarity are spike train distances.These can be divided into spike-resolved, such as the Victor-Purpura and the van Rossum distance, and time-resolved, e.g. the ISI-, the SPIKE- and the RI-SPIKE-distance.

New method: We use independent steady-rate Poisson processes as surrogates for spike trains with fixed rate and no timing information to address two basic questions: How does the sensitivity of the different spike train distances to temporal coding depend on the rates of the two processes and how do the distances deal with very low rates?

Results: Spike-resolved distances always contain rate information even for parameters indicating time coding. This is an issue for reasonably high rates but beneficial for very low rates. In contrast, the operational range for detecting time coding of time-resolved distances is superior at normal rates, but these measures produce artefacts at very low rates. The RI-SPIKE-distance is the only measure that is sensitive to timing information only.

Comparison with existing methods: While our results on rate-dependent expectation values for the spike-resolved distances agree with Chicharro et al. (2011), we here go one step further and specifically investigate applicability for very low rates.

Conclusions: The most appropriate measure depends on the rates of the data being analysed. Accordingly, we summarize our results in one table that allows an easy selection of the preferred measure for any kind of data.


The detection of directional couplings between dynamics based on measured spike trains is a crucial problem in the understanding of many different systems. In particular, in neuroscience it is important to assess the connectivity between neurons.One of the approaches that can estimate directional coupling from the analysis of point processes is the nonlinear interdependence measure L. Although its efficacy has already been demonstrated, it still needs to be tested under more challenging and realistic conditions prior to an application to real data. Thus, in this paper

we use the Hindmarsh-Rose model system to test the method in the presence of noise and for different spiking regimes.We also examine the influence of different parameters and spike train distances. Our results show that the measure L is versatile and robust to various types of noise, and thus suitable for application to experimental data.

Kreuz T, Satuvuori E, Mukansky M

Scholarpedia 12(7):42441 (2017)

SPIKE-order and Spike Train Order (Kreuz et al., 2017) are two indicators that allow to sort multiple sequences of discrete events (here spike trains) from leader to follower and to quantify the consistency of the temporal leader-follower relationships for both the original and the optimized sorting. This is achieved via the Synfire Indicator which attains its maximal value of 1 for a perfect synfire pattern in which all neurons fire repeatedly in a consistent order from leader to follower (Figure 1a). An example of the sorting is shown in the next two subplots. Whereas Figure 1b shows an unsorted spike train set, in Figure 1c the same spike trains have been sorted to become as close as possible to a synfire pattern. Now the spike trains that tend to fire first lead the spike trains with predominantly trailing spikes.

Satuvuori E, Mulansky M, Bozanic N, Malvestio I, Zeldenrust F, Lenk K, Kreuz T

JNeurosci Methods 287, 25 and arXiv [PDF] (2017) [PDF]

Background: Measures of spike train synchrony are widely used in both experimental and computational neuroscience. Time-scale independent and parameter-free measures, such as the ISI-distance, the SPIKE-distance and SPIKE-synchronization, are preferable to time scale parametric measures, since by adapting to the local firing rate they take into account all the time scales of a given dataset.

New method: In data containing multiple time scales (e.g. regular spiking and bursts) one is typically less interested in the smallest time scales and a more adaptive approach is needed. Here we propose the A-ISI-distance, the A-SPIKE-distance and A-SPIKE-synchronization, which generalize the original measures by considering the local relative to the global time scales. For the A-SPIKE-distance we also introduce a rate-independent extension called the RIA-SPIKE-distance, which focuses specifically on spike timing.

Results: The adaptive generalizations A-ISI-distance and A-SPIKE-distance allow to disregard spike time differences that are not relevant on a more global scale. A-SPIKE-synchronization does not any longer demand an unreasonably high accuracy for spike doublets and coinciding bursts. Finally, the RIA-SPIKE-distance proves to be independent of rate ratios between spike trains.

Comparison with existing methods: We find that compared to the original versions the A-ISI-distance and the A-SPIKE-distance yield improvements for spike trains containing different time scales without exhibiting any unwanted side effects in other examples. A-SPIKE-synchronization matches spikes more efficiently than SPIKE-synchronization.

Conclusions: With these proposals we have completed the picture, since we now provide adaptive generalized measures that are sensitive to firing rate only (A-ISI-distance), to timing only (ARI-SPIKE-distance),and to both at the same time (A-SPIKE-distance).

Kreuz T, Satuvuori E, Pofahl M, Mulansky M

New Journal of Physics 19, 043028 and arXiv [PDF] (2017) [PDF]

Repetitive spatio-temporal propagation patterns are encountered in fields as wide-ranging as climatology, social communication and network science. In neuroscience, perfectly consistent repetitions of the same global propagation pattern are called a synfire pattern. For any recording of sequences of discrete events (in neuroscience terminology: sets of spike trains) the questions arise how closely it resembles such a synfire pattern and which are the spike trains that lead/follow. Here we address these questions and introduce an algorithm built on two new indicators, termed SPIKE-order and spike train order, that define the synfire indicator value, which allows to sort multiple spike trains from leader to follower and to quantify the consistency of the temporal leader-follower relationships for both the original and the optimized sorting. We demonstrate our new approach using artificially generated datasets before we apply it to analyze the consistency of propagation patterns in two real datasets from neuroscience (giant depolarized potentials in mice slices) and climatology (El Niño sea surface temperature recordings). The new algorithm is distinguished by conceptual and practical simplicity, low computational cost, as well as flexibility and universality.

Mulansky M, Kreuz T

Software X 5, 183 and arXiv [PDF] (2016) [PDF]

Understanding how the brain functions is one of the biggest challenges of our time. The analysis of experimentally recorded neural firing patterns (spike trains) plays a crucial role in addressing this problem. Here, the PySpike library is introduced, a Python package for spike train analysis providing parameter-free and time-scale independent measures of spike train synchrony. It allows to compute similarity and dissimilarity profiles, averaged values and distance matrices. Although mainly focusing on neuroscience, PySpike can also be applied in other contexts like climate research or social sciences. The package is available as Open Source on Github and PyPI.

Mulansky M, Bozanic N, Sburlea A, Kreuz T

IEEE Proceeding on Event-based Control, Communication, and Signal Processing (EBCCSP) 1-8 and arXiv [PDF] (2015) [PDF]

Measures of spike train synchrony have proven a valuable tool in both experimental and computational neuroscience. Particularly useful are time-resolved methods such as the ISI- and the SPIKE-distance, which have already been applied in various bivariate and multivariate contexts. Recently, SPIKE-Synchronization was proposed as another time-resolved synchronization measure. It is based on Event-Synchronization and has a very intuitive interpretation. Here, we present a detailed analysis of the mathematical properties of these three synchronization measures. For example, we were able to obtain analytic expressions for the expectation values of the ISI-distance and SPIKE-Synchronization for Poisson spike trains. For the SPIKE-distance we present an empirical formula deduced from numerical evaluations. These expectation values are crucial for interpreting the synchronization of spike trains measured in experiments or numerical simulations, as they represent the point of reference for fully randomized spike trains.

Kreuz T, Mulansky M, Bozanic N

JNeurophysiol 113, 3432 (2015) [PDF]

Techniques for recording large-scale neuronal spiking activity are developing very fast. This leads to an increasing demand for algorithms capable of analyzing large amounts of experimental spike train data. One of the most crucial and demanding tasks is the identification of similarity patterns with a very high temporal resolution and across different spatial scales. To address this task, in recent years three time-resolved measures of spike train synchrony have been proposed, the ISIdistance, the SPIKE-distance, and event synchronization. The Matlab source codes for calculating and visualizing these measures have been made publicly available. However, due to the many different possible representations of the results the use of these codes is rather complicated and their application requires some basic knowledge of Matlab. Thus it became desirable to provide a more user-friendly and interactive interface. Here we address this need and present SPIKY, a graphical user interface that facilitates the application of time-resolved measures of spike train synchrony to both simulated and real data. SPIKY includes implementations of the ISI-distance, the SPIKE-distance, and the SPIKE-synchronization (an improved and simplified extension of event synchronization) that have been optimized with respect to computation speed and memory demand. It also comprises a spike train generator and an event detector that makes it capable of analyzing continuous data. Finally, the SPIKY package includes additional complementary programs aimed at the analysis of large numbers of datasets and the estimation of significance levels.

32) SPIKY

Bozanic N, Mulansky M, Kreuz T

Scholarpedia 9(12), 32344 (2014)

SPIKY (Kreuz et al., 2015) is a graphical user interface written in Matlab that facilitates the application of time-resolved measures of spike train synchrony to both simulated and real data. It contains several approaches to analyze spike train synchrony: the standard Peri-Stimulus Time Histogram (PSTH), the ISI-distance, SPIKE-distance, and SPIKE synchronization.

For a given data set SPIKY calculates the measures of choice and allows the user to switch between many different visualizations such as dissimilarity profiles, pairwise dissimilarity matrices, or hierarchical cluster trees. SPIKY also includes a spike train generator and an event detector which makes it capable of analyzing continuous data. Finally, the SPIKY-package includes complementary programs for the automatized analysis of a large number of datasets and for the evaluation of the statistical significance of the results.

Andrzejak RG, Mormann F, Kreuz T

Physical Review E 90, 062906 (2014) [PDF]

The detection of a nonrandom structure from experimental data can be crucial for the classification, understanding, and interpretation of the generating process. We here introduce a rank-based nonlinear predictability score to detect determinism from point process data. Thanks to its modular nature, this approach can be adapted to whatever signature in the data one considers indicative of deterministic structure. After validating our approach using point process signals from deterministic and stochastic model dynamics, we show an application to neuronal spike trains recorded in the brain of an epilepsy patient. While we illustrate our approach in the context of temporal point processes, it can be readily applied to spatial point processes as well.

Kreuz T, Chicharro D, Houghton C, Andrzejak RG, Mormann F

J Neurophysiol 109, 1457 (2013) [PDF]

Recently, the SPIKE-distance has been proposed as a parameter-free and timescale-independent measure of spike train synchrony. This measure is time resolved since it relies on instantaneous estimates of spike train dissimilarity. However, its original definition led to spuriously high instantaneous values for eventlike firing patterns. Here we present a substantial improvement of this measure that eliminates this shortcoming. The reliability gained allows us to track changes in instantaneous clustering, i.e., time-localized patterns of (dis)similarity among multiple spike trains. Additional new features include selective and triggered temporal averaging as well as the instantaneous comparison of spike train groups. In a second step, a causal SPIKEdistance is defined such that the instantaneous values of dissimilarity rely on past information only so that time-resolved spike train synchrony can be estimated in real time. We demonstrate that these methods are capable of extracting valuable information from field data by monitoring the synchrony between neuronal spike trains during an epileptic seizure. Finally, the applicability of both the regular and the real-time SPIKE-distance to continuous data is illustrated on model electroencephalographic (EEG) recordings.

Kreuz T

Scholarpedia 7(12), 30652 (2012)

The SPIKE-distance is an estimator of the dissimilarity between two (or more) spike trains. In contrast to most other spike train distances (such as the Victor-Purpura distance) it is time-resolved and is able to track changes in instantaneous clustering, i.e., time-localized patterns of (dis)similarity among two or more spike trains. Additional features include selective and triggered temporal averaging as well as the instantaneous comparison of spike train groups. The SPIKE-distance can also be formulated as a causal measure which is defined such that the instantaneous values of dissimilarity rely on past information only so that time-resolved spike train synchrony can be estimated in real-time.

The final definition presented here is the one introduced in Kreuz et al., 2013, which improves considerably on the original proposal (Kreuz et al., 2011). Mathematical properties and expectation values for Poisson spike train can be found in Mulansky et al., 2015.

Houghton C, Kreuz T

Network: Computation in neural systems 23, 48 (2012) [PDF]

The van Rossum metric measures the distance between two spike trains. Measuring a single van Rossum distance between one pair of spike trains is not a computationally expensive task, however, many applications require a matrix of distances between all the spike trains in a set or the calculation of a multi-neuron distance between two populations of spike trains. Moreover, often these calculations need to be repeated for many different parameter values. An algorithm is presented here to render these calculation less computationally expensive, making the complexity linear in the number of spikes rather than quadratic.

Kreuz T

Scholarpedia 6(12), 11922 (2011)

Measures of neuronal signal synchrony are estimators of the synchrony between two or sometimes more continuous time series of brain activity which yield low values for independent time series and high values for correlated time series. A complementary class of approaches comprises measures of spike train synchrony which quantify the degree of synchrony between discrete signals.

Synchronization of continuous time series can manifest itself in many different ways. The simplest case of complete synchronization (Fujisaka and Yamada, 1983) can be attained if identical systems are coupled sufficiently strongly so that their states coincide after transients have died out. The concept of generalized synchronization (Afraimovich et al., 1986) introduced for uni-directionally coupled systems, describes the presence of some functional relation between the states of the two systems. Finally, phase synchronization, first described for chaotic oscillators (Rosenblum et al., 1996), is defined as the global entrainment of the phases while the amplitudes may remain uncorrelated.

Following this variety of concepts many different approaches to quantify the degree of synchronization between two continuous signals have been proposed. These approaches comprise linear ones like the cross correlation or the spectral coherence function as well as nonlinear measures like mutual information (Gray, 1990), transfer entropy (Schreiber, 2000), Granger causality (Granger, 1969), or the nonlinear interdependence (Arnhold et al., 1999; Quian Quiroga et al., 2002; Andrzejak et al., 2003). Furthermore, different indices of phase synchronization such as the mean phase coherence (Kuramoto, 1984; Mormann et al., 2000) have been introduced.

Kreuz T

Scholarpedia 6(10), 11934 (2011)

Measures of spike train synchrony (or inversely spike train distances) are estimators of the (dis)similarity between two or sometimes more spike trains. Here spike train refers to a sequence of neuronal action potentials. Under the assumption that neither the shape of the action potential nor the background activity carry relevant information, neuronal responses are reduced to a spike train where the only information maintained is the timing of the individual spikes. A complementary class of approaches comprises measures of neuronal signal synchrony.

Measures that estimate the degree of synchrony between spike trains are important tools for many applications. Among others, they can be used to quantify the reliability of neuronal responses upon repeated presentations of a stimulus (Mainen and Sejnowski, 1995) or to test the performance of neuronal models (Jolivet et al., 2008).

Andrzejak RG, Kreuz T

Eur Phys Lett 96, 50012 (2011) [PDF]

Experimental data comprising both time-continuous flows and point processes are recorded in many scientific disciplines. The characterization of causal interactions from such signals is key to an advanced understanding of the underlying dynamics. We therefore introduce a unified approach to characterize unidirectional couplings between point processes, between flows, as well as between point processes and flows. For this purpose we show and exploit the generality of the asymmetric state similarity conditioning principle. We use Hindmarsh-Rose neuron models and Lorenz oscillators to illustrate the high sensitivity and specificity of our approach.

Chicharro D, Kreuz T, Andrzejak RG

J Neurosci Methods 199, 146 (2011) [PDF]

Time scale parametric spike train distances like the Victor and the van Rossum distances are often applied to study the neural code based on neural stimuli discrimination. Different neural coding hypotheses, such as rate or coincidence coding, can be assessed by combining a time scale parametric spike train distance with a classifier in order to obtain the optimal discrimination performance. The time scale for which the responses to different stimuli are distinguished best is assumed to be the discriminative precision of the neural code. The relevance of temporal coding is evaluated by comparing the optimal discrimination performance with the one achieved when assuming a rate code. We here characterize the measures quantifying the discrimination performance, the discriminative precision, and the relevance of temporal coding. Furthermore, we evaluate the information these quantities provide about the neural code. We show that the discriminative precision is too unspecific to be interpreted in terms of the time scales relevant for encoding. Accordingly, the time scale parametric nature of the distances is mainly an advantage because it allows maximizing the discrimination performance across a whole set of measures with different sensitivities determined by the time scale parameter, but not due to the possibility to examine the temporal properties of the neural code.

Kreuz T, Chicharro D, Greschner M, Andrzejak RG

J Neurosci Methods 195, 92 (2011) [PDF]

A wide variety of approaches to estimate the degree of synchrony between two or more spike trains have been proposed. One of the most recent methods is the ISI-distance which extracts information from the interspike intervals (ISIs) by evaluating the ratio of the instantaneous firing rates. In contrast to most previously proposed measures it is parameter free and time-scale independent. However, it is not well suited to track changes in synchrony that are based on spike coincidences. Here we propose the SPIKE-distance, a complementary measure which is sensitive to spike coincidences but still shares the fundamental advantages of the ISI-distance. In particular, it is easy to visualize in a time-resolved manner and can be extended to a method that is also applicable to larger sets of spike trains. We show the merit of the SPIKE-distance using both simulated and real data.

Haas JS*, Kreuz T*, Torcini A, Politi A, Abarbanel HDI

Eur J Neurosci 32, 1930 (2010) [PDF]

Throughout the brain, neurons encode information in fundamental units of spikes. Each spike represents the combined thresholding of synaptic inputs and intrinsic neuronal dynamics. Here, we address a basic question of spike train formation: how do perithreshold synaptic inputs perturb the output of a spiking neuron? We recorded from single entorhinal principal cells in vitro and drove them to spike steadily at 5 Hz (theta range) with direct current injection, then used a dynamic-clamp to superimpose strong excitatory conductance inputs at varying rates. Neurons spiked most reliably when the input rate matched the intrinsic neuronal firing rate. We also found a striking tendency of neurons to preserve their rates and coefficients of variation, independently of input rates. As mechanisms for this rate maintenance, we show that the efficacy of the conductance inputs varied with the relationship of input rate to neuronal firing rate, and with the arrival time of the input within the natural period. Using a novel method of spike classification, we developed a minimal Markov model that reproduced the measured statistics of the output spike trains and thus allowed us to identify and compare contributions to the rate maintenance and resonance. We suggest that the strength of rate maintenance may be used as a new categorization scheme for neuronal response and note that individual intrinsic spiking mechanisms may play a significant role in forming the rhythmic spike trains of activated neurons; in the entorhinal cortex, individual pacemakers may dominate production of the regional theta rhythm.

Kreuz T, Chicharro D, Andrzejak RG, Haas JS, Abarbanel HDI

J Neurosci Methods 183, 287 (2009) [PDF]

Measures of multiple spike train synchrony are essential in order to study issues such as spike timing reliability, network synchronization, and neuronal coding. These measures can broadly be divided in multivariate measures and averages over bivariate measures. One of the most recent bivariate approaches, the ISI-distance, employs the ratio of instantaneous interspike intervals (ISIs). In this study we propose two extensions of the ISI-distance, the straightforward averaged bivariate ISI-distance and the multivariate ISI-diversity based on the coefficient of variation. Like the original measure these extensions combine many properties desirable in applications to real data. In particular, they are parameter-free, time scale independent, and easy to visualize in a time-resolved manner, as we illustrate with in vitro recordings from a cortical neuron. Using a simulated network of Hindemarsh–Rose neurons as a controlled configuration we compare the performance of our methods in distinguishing different levels of multi-neuron spike train synchrony to the performance of six other previously published measures. We show and explain why the averaged bivariate measures perform better than the multivariate ones and why the multivariate ISIdiversity is the best performer among the multivariate methods. Finally, in a comparison against standard methods that rely on moving window estimates, we use single-unit monkey data to demonstrate the advantages of the instantaneous nature of our methods.

Kreuz T, Haas JS, Morelli A, Abarbanel HDI, Politi A

J Neurosci Methods 165, 151 (2007) [PDF]

Estimating the degree of synchrony or reliability between two or more spike trains is a frequent task in both experimental and computational neuroscience. In recent years, many different methods have been proposed that typically compare the timing of spikes on a certain time scale to be optimized by the analyst. Here, we propose the ISI-distance, a simple complementary approach that extracts information from the interspike intervals by evaluating the ratio of the instantaneous firing rates. The method is parameter free, time scale independent and easy to visualize as illustrated by an application to real neuronal spike trains obtained in vitro from rat slices. In a comparison with existing approaches on spike trains extracted from a simulated Hindemarsh–Rose network, the ISI-distance performs as well as the best time-scale-optimized measure based on spike timing

Kreuz T, Luccioli S, Torcini A

Neurocomputing 70, 1970 (2007) [PDF]

We study the regularity of noise-induced excitations in the FitzHugh–Nagumo (FHN) neuronal model subject to excitatory and inhibitory high-frequency input with and without correlations. For each value of the correlation a relative maximum of spike coherence can be observed for intermediate noise strengths (coherence resonance). Moreover, the FHN system exhibits an absolute maximum of coherent spiking for intermediate values of both the noise amplitude and the strength of correlation (double coherence resonance). The underlying mechanisms can be explained by means of the discrete input statistics.

Torcini A, Luccioli S, Kreuz T

Neurocomputing 70, 1943 (2007) [PDF]

We analyze the response of the Hodgkin–Huxley neuron to a large number of uncorrelated stochastic inhibitory and excitatory postsynaptic spike trains. In order to clarify the various mechanisms responsible for noise-induced spike triggering we examine the model in its silent regime. We report the coexistence of two distinct coherence resonances: the first one at low noise is due to the stimulation of correlated subthreshold oscillations; the second one at intermediate noise variances is instead related to the regularization of the emitted spike trains.

Kreuz T, Mormann F, Andrzejak RG, Kraskov A, Lehnertz K, Grassberger P

Phys D 225, 29 (2007) [PDF]

The investigation of synchronization phenomena on measured experimental data such as biological time series has recently become an increasing focus of interest. Different approaches for measuring synchronization have been proposed that rely on certain characteristic features of the dynamical system under investigation. For experimental data the underlying dynamics are usually not completely known, therefore it is difficult to decide a priori which synchronization measure is most suitable for an analysis. In this study we use three different coupled model systems to create a ‘controlled’ setting for a comparison of six different measures of synchronization. All measures are compared to each other with respect to their ability to distinguish between different levels of coupling and their robustness against noise. Results show that the measure to be applied to a certain task can not be chosen according to a fixed criterion but rather pragmatically as the measure which most reliably yields plausible information in test applications, although certain dynamical features of a system under investigation (e.g., power spectra, dimension) may render certain measures more suitable than others.

Kreuz T, Luccioli S, Torcini A

Phys Rev Lett 97, 238101 (2006) [PDF]

We study the influence of correlations among discrete stochastic excitatory or inhibitory inputs on the response of the FitzHugh-Nagumo neuron model. For any level of correlation, the emitted signal exhibits at some finite noise intensity a maximal degree of regularity, i.e., a coherence resonance. Furthermore, for either inhibitory or excitatory correlated stimuli, a double coherence resonance is observable. Double coherence resonance refers to a (absolute) maximum coherence in the output occurring for an optimal combination of noise variance and correlation. All of these effects can be explained by taking advantage of the discrete nature of the correlated inputs.

Luccioli S, Kreuz T, Torcini A

Phys Rev E 73, 041902 (2006) [PDF]

The response of the Hodgkin-Huxley neuronal model subjected to stochastic uncorrelated spike trains originating from a large number of inhibitory and excitatory post-synaptic potentials is analyzed in detail. The model is examined in its three fundamental dynamical regimes: silence, bistability, and repetitive firing. Its response is characterized in terms of statistical indicators interspike-interval distributions and their first moments as well as of dynamical indicators autocorrelation functions and conditional entropies. In the silent regime, the coexistence of two different coherence resonances is revealed: one occurs at quite low noise and is related to the stimulation of subthreshold oscillations around the rest state; the second one at intermediate noise variance is associated with the regularization of the sequence of spikes emitted by the neuron. Bistability in the low noise limit can be interpreted in terms of jumping processes across barriers activated by stochastic fluctuations. In the repetitive firing regime a maximization of incoherence is observed at finite noise variance. Finally, the mechanisms responsible for the different features appearing in the interspike-interval distributions like multimodality and exponential tails are clearly identified in the various regimes.

Andrzejak RG, Mormann F, Widman G, Kreuz T, Elger CE, Lehnertz K

Epilepsy Research 69, 30 (2006) [PDF]

An advanced characterization of the complicated dynamical system brain is one of science's biggest challenges. Nonlinear time series analysis allows characterizing nonlinear dynamical systems in which low-dimensional nonlinearity gives rise to complex and irregular behavior. While several studies indicate that nonlinear methods can extract valuable information from neuronal dynamics, others doubt their necessity and conjecture that the same information can be obtained using classical linear techniques. To address this issue, we compared these two concepts, but included furthermore a combination of nonlinear measures with surrogates, an approach that has been designed to specifically focus on nonlinearity. As a benchmark we used the discriminative power to detect the seizure-generating hemisphere in medically intractable mesial temporal lobe epilepsy. We analyzed intracranial electroencephalographic recordings from the seizure-free interval of 29 patients. While the performance of both linear and nonlinear measures was weak, if not insignificant, a very high performance was obtained by the use of surrogate-corrected measures. Focusing on nonlinearity by using a combination of nonlinear measures with surrogates appears as the key to a successful characterization of the spatial distribution of the epileptic process.

Mormann F, Kreuz T, Rieke C, Andrzejak RG, Kraskov A, David P, Elger CE, Lehnertz K

Clin Neurophysiol 116, 569 (2005) [PDF]

Objective: An important issue in epileptology is the question whether information extracted from the EEG of epilepsy patients can be used for the prediction of seizures. Several studies have claimed evidence for the existence of a pre-seizure state that can be detected using different characterizing measures. In this paper, we evaluate the predictability of seizures by comparing the predictive performance of a variety of univariate and bivariate measures comprising both linear and non-linear approaches.

Methods: We compared 30 measures in terms of their ability to distinguish between the interictal period and the pre-seizure period. After completely analyzing continuous inctracranial multi-channel recordings from five patients lasting over days, we used ROC curves to distinguish between the amplitude distributions of interictal and preictal time profiles calculated for the respective measures. We compared different evaluation schemes including channelwise and seizurewise analysis plus constant and adaptive reference levels. Particular emphasis was placed on statistical validity and significance.

Results: Univariate measures showed statistically significant performance only in a channelwise, seizurewise analysis using an adaptive baseline. Preictal changes for these measures occurred 5–30 min before seizures. Bivariate measures exhibited high performance values reaching statistical significance for a channelwise analysis using a constant baseline. Preictal changes were found at least 240 min before seizures. Linear measures were found to perform similar or better than non-linear measures.

Conclusions: Results provide statistically significant evidence for the existence of a preictal state. Based on our findings, the most promising approach for prospective seizure anticipation could be a combination of bivariate and univariate measures.

Significance: Many measures reported capable of seizure prediction in earlier studies are found to be insignificant in performance, which underlines the need for statistical validation in this field.

Kreuz T, Andrzejak RG, Mormann F, Kraskov A, Stögbauer H, Elger CE, Lehnertz K, Grassberger P

Phys Rev E 69, 061915 (2004) [PDF]

In a growing number of publications it is claimed that epileptic seizures can be predicted by analyzing the electroencephalogram (EEG) with different characterizing measures. However, many of these studies suffer from a severe lack of statistical validation. Only rarely are results passed to a statistical test and verified against some null hypothesis H0 in order to quantify their significance. In this paper we propose a method to statistically validate the performance of measures used to predict epileptic seizures. From measure profiles rendered by applying a moving-window technique to the electroencephalogram we first generate an ensemble of surrogates by a constrained randomization using simulated annealing. Subsequently the seizure prediction algorithm is applied to the original measure profile and to the surrogates. If detectable changes before seizure onset exist, highest performance values should be obtained for the original measure profiles and the null hypothesis. “The measure is not suited for seizure prediction” can be rejected. We demonstrate our method by applying two measures of synchronization to a quasicontinuous EEG recording and by evaluating their predictive performance using a straightforward seizure prediction statistics. We would like to stress that the proposed method is rather universal and can be applied to many other prediction and detection problems

Kraskov A, Kreuz T, Andrzejak RG, Stögbauer H, Nadler W, Grassberger P

arXiv (2004) [PDF]

We demonstrate by means of a simple example that the arbitrariness of defining a phase from an aperiodic signal is not just an academic problem, but is more serious and fundamental. Decomposition of the signal into components with positive phase velocities is proposed as an old solution to this new problem.

Andrzejak RG, Kraskov A, Stögbauer H, Mormann F, Kreuz T

Phys Rev E 68, 066202 (2003) [PDF]

The concept of surrogates allows testing results from time series analysis against specified null hypotheses. In application to bivariate model dynamics we here compare different types of surrogates, each designed to test against a different null hypothesis, e.g., an underlying bivariate linear stochastic process. Two measures that aim at a characterization of interdependence between nonlinear deterministic dynamics were used as discriminating statistics. We analyze eight different stochastic and deterministic models not only to demonstrate the power of the surrogates, but also to reveal some pitfalls and limitations.

We agree with the Comment by Duckrow and Albano [Phys. Rev. E 67, 063901 (2003)] that mutual information, estimated with an optimized algorithm, can be a useful tool for studying synchronization in real data. However, we point out that the improvement they found is mainly due to an interesting but nonstandard embedding technique used, and not so much due to the algorithm used for the estimation of mutual information itself. We also address the issue of stationarity of electroencephalographic (EEG) data

Rieke C, Mormann F, Andrzejak RG, Kreuz T, David P, Elger CE, Lehnertz K

IEEE Trans Biomed Eng 50, 634 (2003) [PDF]

A number of recent studies indicate that nonlinear electroencephalogram (EEG) analyses allow to define a state predictive of an impending epileptic seizure. In this paper, we combine a method for detecting nonlinear determinism with a novel test for stationarity to characterize EEG recordings from both the seizure-free interval and the preseizure phase. We discuss differences between these periods, particularly an increased occurrence of stationary, nonlinear segments prior to seizures. These differences seem most prominent for recording sites within the seizure-generating area and for EEG segments less than one minute’s length.

Mormann F, Kreuz T, Andrzejak RG, David P, Lehnertz K, Elger CE

Epilepsy Res. 53, 171 (2003) [PDF]

The exact mechanisms leading to the occurrence of epileptic seizures in humans are still poorly understood. It is widely accepted, however, that the process of seizure generation is closely associated with an abnormal synchronization of neurons. In order to investigate this process, we here measure phase synchronization between different regions of the brain using intracranial EEG recordings. Based on our preliminary finding of a preictal drop in synchronization, we investigate whether this phenomenon can be used as a sensitive and specific criterion to characterize a preseizure state and to distinguish this state from the interictal interval.

Applying an automated technique for detecting decreased synchronization to EEG recordings from a group of 18 patients with focal epilepsy comprising a total of 117 h, we observe a characteristic decrease in synchronization prior to 26 out of 32 analyzed seizures at a very high specificity as tested on interictal recordings. The duration of this preictal state is found to range from several minutes up to a few hours. Investigation of the spatial distribution of preictal desynchronization indicates that the process of seizure generation in focal epilepsy is not necessarily confined to the focus itself but may instead involve more distant, even contralateral areas of the brain. Finally, we demonstrate an intrahemispheric asymmetry in the spatial dynamics of preictal desynchronization that is found in the majority of seizures and appears to be an immanent part of the mechanisms underlying the initiation of seizures in humans.

Mormann F, Andrzejak RG, Kreuz T, Rieke C, David P, Elger CE, Lehnertz K

Phys. Rev. E 67, 021912 (2003) [PDF]

The question whether information extracted from the electroencephalogram ~EEG! of epilepsy patients can be used for the prediction of seizures has recently attracted much attention. Several studies have reported evidence for the existence of a preseizure state that can be detected using different measures derived from the theory of dynamical systems. Most of these studies, however, have neglected to sufficiently investigate the specificity of the observed effects or suffer from other methodological shortcomings. In this paper we present an automated technique for the detection of a preseizure state from EEG recordings using two different measures for synchronization between recording sites, namely, the mean phase coherence as a measure for phase synchronization and the maximum linear cross correlation as a measure for lag synchronization. Based on the observation of characteristic drops in synchronization prior to seizure onset, we used this phenomenon for the characterization of a preseizure state and its distinction from the remaining seizure-free interval. After optimizing our technique on a group of 10 patients with temporal lobe epilepsy we obtained a successful detection of a preseizure state prior to 12 out of 14 analyzed seizures for both measures at a very high specificity as tested on recordings from the seizure-free interval. After checking for in-sample overtraining via cross validation, we applied a surrogate test to validate the observed predictability. Based on our results, we discuss the differences of the two synchronization measures in terms of the dynamics underlying seizure generation in focal epilepsies.

Lehnertz K, Mormann F, Kreuz T, Andrzejak RG, Rieke C, David P, Elger CE

IEEE Trans Biomed Eng (Special Issue), 22, 57 (2003) [PDF]

Attempting to Increase Insight into the Spatio-Temporal Dynamics of the Epileptogenic Process to Address One of the Greatest Challenges in Epileptology

Andrzejak RG, Mormann F, Kreuz T, Rieke C, Kraskov A, Elger CE, Lehnertz K

Phys Rev E 67, 010901 (2003) [PDF]

A rapidly growing number of studies deals with the prediction of epileptic seizures. For this purpose, various techniques derived from linear and nonlinear time series analysis have been applied to the electroencephalogram of epilepsy patients. In none of these works, however, the performance of the seizure prediction statistics is tested against a null hypothesis, an otherwise ubiquitous concept in science. In consequence, the evaluation of the reported performance values is problematic. Here, we propose the technique of seizure time surrogates based on a Monte Carlo simulation to remedy this deficit.

Quian Quiroga R, Kreuz T, and Grassberger P

Phys Rev E 66, 041904 (2002) [PDF]

We propose a simple method to measure synchronization and time-delay patterns between signals. It is based on the relative timings of events in the time series, defined, e.g., as local maxima. The degree of synchronization is obtained from the number of quasisimultaneous appearances of events, and the delay is calculated from the precedence of events in one signal with respect to the other. Moreover, we can easily visualize the time evolution of the delay and synchronization level with an excellent resolution. We apply the algorithm to short rat electroencephalogram (EEG) signals, some of them containing spikes. We also apply it to an intracranial human EEG recording containing an epileptic seizure, and we propose that the method might be useful for the detection of epileptic foci. It can be easily extended to other types of data and it is very simple and fast, thus being suitable for on-line implementations.

Quian Quiroga R, Kraskov A, Kreuz T, and Grassberger P

Phys Rev E 65, 041903 (2002) [PDF]

We study the synchronization between left and right hemisphere rat electroencephalographic (EEG) channels by using various synchronization measures, namely nonlinear interdependences, phase synchronizations, mutual information, cross correlation, and the coherence function. In passing we show a close relation between two recently proposed phase synchronization measures and we extend the definition of one of them. In three typical examples we observe that except mutual information, all these measures give a useful quantification that is hard to be guessed beforehand from the raw data. Despite their differences, results are qualitatively the same. Therefore, we claim that the applied measures are valuable for the study of synchronization in real data. Moreover, in the particular case of EEG signals their use as complementary variables could be of clinical relevance.

Lehnertz K, Andrzejak RG, Arnhold J, Kreuz T, Mormann F, Rieke C, Widman G, Elger CE

J Clin Neurophysiol 18, 209-222 (2001) [PDF]

Several recent studies emphasize the high value of nonlinear EEG analysis particularly for improved characterization of epileptic brain states. In this review the authors report their work to increase insight into the spatial and temporal dynamics of the epileptogenic process. Specifically, they discuss possibilities for seizure anticipation, which is one of the most challenging aspects of epileptology. Although there are numerous studies exploring basic neuronal mechanisms that are likely to be associated with seizures, to date no definite information is available regarding how, when, or why a seizure occurs. Nonlinear EEG analysis now provides strong evidence that the interictal–ictal state transition is not an abrupt phenomenon. Rather, findings indicate that it is indeed possible to detect a preseizure phase. The unequivocal definition of such a state with a sufficient length would enable investigations of basic mechanisms leading to seizure initiation in humans, and development of adequate seizure prevention strategies.