Detecting anomalies in time series data via a deep learning algorithm combining wavelets, neural networks and Hilbert transform

Stratis Kanarachos, Stavros Richard G. Christopoulos, Alexander Chroneos, Michael E. Fitzpatrick

Research output: Contribution to journalArticlepeer-review

94 Citations (Scopus)

Abstract

The quest for more efficient real-time detection of anomalies in time series data is critically important in numerous applications and systems ranging from intelligent transportation, structural health monitoring, heart disease, and earthquake prediction. Although the range of application is wide, anomaly detection algorithms are usually domain specific and build on experts’ knowledge. Here a new signal processing algorithm – inspired by the deep learning paradigm – is presented that combines wavelets, neural networks, and Hilbert transform. The algorithm performs robustly and is transferable. The proposed neural network structure facilitates learning short and long-term pattern interdependencies; a task usually hard to accomplish using standard neural network training algorithms. The paper provides guidelines for selecting the neural network's buffer size, training algorithm, and anomaly detection features. The algorithm learns the system's normal behavior and does not require the existence of anomalous data for assessing its statistical significance. This is an essential attribute in applications that require customization. Anomalies are detected by analysing hierarchically the instantaneous frequency and amplitude of the residual signal using probabilistic Receiver Operating Characteristics. The method is shown to be able to automatically detect anomalies in the Seismic Electrical Signal that could be used to predict earthquake activity. Furthermore, the method can be used in combination with crowdsourcing of smartphone data to locate road defects such as potholes and bumps for intervention and repair.

Original languageEnglish
Pages (from-to)292-304
Number of pages13
JournalExpert Systems with Applications
Volume85
Early online date23 May 2017
DOIs
Publication statusPublished - 1 Nov 2017
Externally publishedYes

Fingerprint

Dive into the research topics of 'Detecting anomalies in time series data via a deep learning algorithm combining wavelets, neural networks and Hilbert transform'. Together they form a unique fingerprint.

Cite this