Abstract
At their core, many time series data mining algorithms reduce to reasoning about the shapes of time series subsequences. This requires an effective distance measure, and for last two decades most algorithms use Euclidean Distance or DTW as their core subroutine. We argue that these distance measures are not as robust as the community seems to believe. The undue faith in these measures perhaps derives from an overreliance on the benchmark datasets and self-selection bias. The community is simply reluctant to address more difficult domains, for which current distance measures are ill-suited. In this work, we introduce a novel distance measure MPdist. We show that our proposed distance measure is much more robust than current distance measures. For example, it can handle data with missing values or spurious regions. Furthermore, it allows us to successfully mine datasets that would defeat any Euclidean or DTW distance-based algorithm. Additionally, we show that our distance measure can be computed so efficiently as to allow analytics on very fast arriving streams.
Original language | English |
---|---|
Pages (from-to) | 1104–1135 |
Number of pages | 32 |
Journal | Data Mining and Knowledge Discovery |
Volume | 34 |
Issue number | 4 |
Early online date | 30 May 2020 |
DOIs | |
Publication status | Published - Jul 2020 |
Keywords
- Time Series
- Distance Measure
- Matrix Profile
Profiles
-
Tony Bagnall
- School of Computing Sciences - Honorary Professorial Fellow
- Data Science and Statistics - Member
Person: Honorary, Research Group Member