Giter Club home page Giter Club logo

shapecnf's Introduction

Shape-Based Conditional Neural Field for Wrist-Worn Change-Point Detection

This repository is the official implementation of our paper "Shape-Based Conditional Neural Field for Wrist-Worn Change-Point Detection".

ShapeCNF is a simple, fast, and accurate change-point detection method which uses shape-based features to model the patterns and a conditional neural field to model the temporal correlations among the time regions. It's the improved version of Shape-CD: Change-Point Detection in Time-Series Data with Shapes and Neurons.

Our contributions are as follows.

  • We propose a hybrid model consisting of shape-based features learning (dynamic time warping, DTW) and conditional neural field (CNF) for change-point detection. ShapeCNF first captures the dissimilarity scores as features between adjacent time intervals. Then, in order to learn temporal dependencies, these features are non-linearly combined by CNF to model the non-linear relationship of the dissimilarities from different time-series dimensions.

  • Extensive experiments on two highly dynamic and complex human activity datasets, i.e. ExtraSensory and HASC, have shown that our method outperforms the state-of-the-art methods for change-point detection, demonstrating its superiority both in terms of speed and accuracy on non-stationary, complex, and highly varying time-series data.

  • ShapeCNF is a simple model with only a few hundreds parameters which is order of magnitudes smaller than deep learning models like Long Short-Term Memory (LSTM). Thus, the proposed method is fast enough to be utilized in both online and offline scenarios.

The architecture of ShapeCNF. It has two major components: 1) shape-based feature extractor and 2) conditional neural field. The shape-based feature extractor takes data segments as input, and encodes each segment as a fixed-length vector representation (i.e shape-based feature) by using dynamic time warping. The CRF component takes the set of shape-based features as input and models their temporal correlations. Then CRF component outputs the marginal distribution of each data segment being normal or change point given the set of shape-based features.

Results

We evaluate our approach on two human acticity time-series datasets, which are often considered for change point detection.

We compare ShapeCNF with three representative baselines:

  • RuLSIF [1].
  • KL-CPD [2].
  • Long short-term memory (LSTM) [3, 4].

The results are shown below.

Table 1 AUC of different methods for change-point detection

Dataset RuLSIF LSTM KL-CPD ShapeCNF
ExtraSensory 0.7863 0.6158 0.6104 0.8834
HASC 0.6332 0.4579 0.6490 0.7627

Table 2 Computational time for per-segment (milisecond)

Dataset RuLSIF LSTM KL-CPD ShapeCNF
ExtraSensory 474.941 9.616 394.331 4.221
HASC 473.140 6.346 375.330 3.118

Citation

  • Shi, Yuang, Varsha Suresh, and Wei Tsang Ooi. “Shape-Based Conditional Neural Field for Wrist- Worn Change-Point Detection.” 2022 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops). IEEE, 2022.

Reference

[1] S. Liu, M. Yamada, N. Collier, and M. Sugiyama, “Change-pointdetection in time-series data by relative density-ratio estimation,” Neural Networks, vol. 43, pp. 72–83, 2013.

[2] W.-C. Chang, C.-L. Li, Y. Yang, and B. P ́oczos, “Kernel change-point detection with auxiliary deep generative models,”arXiv preprint arXiv:1901.06077, 2019.

[3] J. Kim, J. Kim, H. L. T. Thu, and H. Kim, “Long short term memoryrecurrent neural network classifier for intrusion detection,” in 2016 International Conference on Platform Technology and Service (PlatCon). IEEE, 2016, pp. 1–5.

[4] C. Yin, Y. Zhu, J. Fei, and X. He, “A deep learning approach forintrusion detection using recurrent neural networks,” IEEE Access, vol. 5,pp. 21 954–21 961, 2017

Contact

shapecnf's People

Contributors

shiyuang-scu avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.