MTV: Visual Analytics for Detecting, Investigating, and Annotating Anomalies in Multivariate Time Series

Fig. 1. The MTV interface, displaying an analysis of stock data. The Signal Overview (a) displays multiple signals (in this case, stocks) that share the same horizontal timeline and highlights anomalous events with a warning color (a1). Users pick a signal of interest (i.e., COKE) and brush a segment (a2) to observe its details and interact with the events in the Signal Focused View (b). Events can be color-tagged (e.g., green normal, orange investigate, red problem) and filtered in the top header. The predicted errors (b1) can be toggled to explain why a certain event (b2) was identified by the machine learning algorithm. The Side Panel (c) includes four collapsible views — the Periodical View (c1, c2), Signal Annotations View, Event Details View, and Similar Segments View — which allow users to investigate and annotate events efficiently and collaboratively.

[1]  Mauro de Mesquita Spinola,et al.  THE 3C COOPERATION MODEL APPLIED TO THE CLASSICAL REQUIREMENT ANALYSIS , 2012, ICISTM 2012.

[2]  Kalyan Veeramachaneni,et al.  The Machine Learning Bazaar: Harnessing the ML Ecosystem for Effective System Development , 2019, SIGMOD Conference.

[3]  Jarke J. van Wijk,et al.  Cluster and Calendar Based Visualization of Time Series Data , 1999, INFOVIS.

[4]  Martin Wattenberg,et al.  Voyagers and voyeurs: supporting asynchronous collaborative information visualization , 2007, CHI.

[5]  Marcos V. O. de Assis,et al.  Anomaly Detection Using Forecasting Methods ARIMA and HWDS , 2013, 2013 32nd International Conference of the Chilean Computer Science Society (SCCC).

[6]  Daniel Jurafsky,et al.  Understanding Neural Networks through Representation Erasure , 2016, ArXiv.

[7]  Jeffrey Heer,et al.  Design Considerations for Collaborative Visual Analytics , 2008, Inf. Vis..

[8]  Rhema Vaithianathan,et al.  Sibyl: Understanding and Addressing the Usability Challenges of Machine Learning In High-Stakes Decision Making , 2021, IEEE Transactions on Visualization and Computer Graphics.

[9]  Niklas Elmqvist,et al.  Graphical Perception of Multiple Time Series , 2010, IEEE Transactions on Visualization and Computer Graphics.

[10]  Susan R. Fussell,et al.  Effects of Sensemaking Translucence on Distributed Collaborative Analysis , 2016, CSCW.

[11]  Jürgen Bernard,et al.  VIAL: a unified process for visual interactive labeling , 2018, The Visual Computer.

[12]  Ping Guo,et al.  Visual Analysis of the Air Pollution Problem in Hong Kong , 2007, IEEE Transactions on Visualization and Computer Graphics.

[13]  Thomas Ludwig,et al.  Collaborative Visualization for Supporting the Analysis of Mobile Device Data , 2015, ECSCW.

[14]  Heidrun Schumann,et al.  Visualization of Time-Oriented Data , 2011, Human-Computer Interaction Series.

[15]  Cecilia R. Aragon,et al.  Analysis and Visualization of Sentiment and Emotion on Crisis Tweets , 2014, CDVE.

[16]  Jeffrey Heer,et al.  CommentSpace: structured support for collaborative visual analysis , 2011, CHI.

[17]  Vijaymeena M.K,et al.  A Survey on Similarity Measures in Text Mining , 2016 .

[18]  Meredith Ringel Morris,et al.  Collaborative search revisited , 2013, CSCW.

[19]  Clara Pizzuti,et al.  Fast Outlier Detection in High Dimensional Spaces , 2002, PKDD.

[20]  Bin Zhou,et al.  BeatGAN: Anomalous Rhythm Detection using Adversarially Generated Time Series , 2019, IJCAI.

[21]  Hans Hagen,et al.  Collaborative visualization: Definition, challenges, and research agenda , 2011, Inf. Vis..

[22]  Chirag Shah,et al.  Collaborative Information Seeking: The Art and Science of Making the Whole Greater than the Sum of All , 2012 .

[23]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD '00.

[24]  M. Sheelagh T. Carpendale,et al.  Creation and Collaboration: Engaging New Audiences for Information Visualization , 2008, Information Visualization.

[25]  K. Veeramachaneni,et al.  TadGAN: Time Series Anomaly Detection Using Generative Adversarial Networks , 2020, 2020 IEEE International Conference on Big Data (Big Data).

[26]  Jian Zhao,et al.  Supporting Handoff in Asynchronous Collaborative Sensemaking Using Knowledge-Transfer Graphs , 2018, IEEE Transactions on Visualization and Computer Graphics.

[27]  Jakob E. Bardram,et al.  Collaborative Affordances of Medical Records , 2018, Computer Supported Cooperative Work (CSCW).

[28]  Juho Kim,et al.  Collaborative Dynamic Queries: Supporting Distributed Small Group Decision-making , 2018, CHI.

[29]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[30]  Marco Hutter,et al.  Comparing Visual-Interactive Labeling with Active Learning: An Experimental Study , 2018, IEEE Transactions on Visualization and Computer Graphics.

[31]  M. Sheelagh T. Carpendale,et al.  Interactive Tree Comparison for Co-located Collaborative Information Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.

[32]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[33]  Marc Alexa,et al.  Visualizing time-series on spirals , 2001, IEEE Symposium on Information Visualization, 2001. INFOVIS 2001..

[34]  Cheryl Z. Qian,et al.  AnnotatedTimeTree: Visualization and annotation of news text and other heterogeneous document collections , 2014, 2014 IEEE Conference on Visual Analytics Science and Technology (VAST).

[35]  F. Itakura,et al.  Minimum prediction residual principle applied to speech recognition , 1975 .

[36]  Anastasia Bezerianos,et al.  Comparing Similarity Perception in Time Series Visualizations , 2019, IEEE Transactions on Visualization and Computer Graphics.

[37]  Tamara Munzner,et al.  LiveRAC: interactive visual exploration of system management time-series data , 2008, CHI.

[38]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[39]  Martin Wattenberg,et al.  Communication-minded visualization : A call to action , 2006 .

[40]  Kalyan Veeramachaneni,et al.  VBridge: Connecting the Dots Between Features and Data to Explain Healthcare Models , 2021, IEEE Transactions on Visualization and Computer Graphics.

[41]  I. V. Ramakrishnan,et al.  Toward a Multi-Analyst, Collaborative Framework for Visual Analytics , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[42]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[43]  Subutai Ahmad,et al.  Unsupervised real-time anomaly detection for streaming data , 2017, Neurocomputing.

[44]  Sungzoon Cho,et al.  Variational Autoencoder based Anomaly Detection using Reconstruction Probability , 2015 .

[45]  Milagros Miceli,et al.  Between Subjectivity and Imposition , 2020, Proc. ACM Hum. Comput. Interact..

[46]  Alan F. Blackwell,et al.  Visual discovery and model-driven explanation of time series patterns , 2016, 2016 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[47]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[48]  Mary Czerwinski,et al.  Co-Located Collaborative Visual Analytics around a Tabletop Display , 2012, IEEE Transactions on Visualization and Computer Graphics.

[49]  Thomas Ertl,et al.  Visual Classifier Training for Text Document Retrieval , 2012, IEEE Transactions on Visualization and Computer Graphics.

[50]  Ke Xu,et al.  CloudDet: Interactive Visual Analysis of Anomalous Performances in Cloud Computing Systems , 2019, IEEE Transactions on Visualization and Computer Graphics.

[51]  Petra Isenberg,et al.  Collaborative Brushing and Linking for Co‐located Visual Analytics of Document Collections , 2009, Comput. Graph. Forum.

[52]  Qian Yang,et al.  Designing Theory-Driven User-Centric Explainable AI , 2019, CHI.

[53]  Burr Settles,et al.  Closing the Loop: Fast, Interactive Semi-Supervised Annotation With Queries on Features and Instances , 2011, EMNLP.

[54]  Margot Brereton,et al.  Collaborative Exploration and Sensemaking of Big Environmental Sound Data , 2017, Computer Supported Cooperative Work (CSCW).

[55]  Victoria J. Hodge,et al.  A Survey of Outlier Detection Methodologies , 2004, Artificial Intelligence Review.

[56]  Eric Horvitz,et al.  SearchTogether: an interface for collaborative web search , 2007, UIST.

[57]  Klaus Mueller,et al.  A Visual Analytics Framework for the Detection of Anomalous Call Stack Trees in High Performance Computing Applications , 2019, IEEE Transactions on Visualization and Computer Graphics.

[58]  Valentino Constantinou,et al.  Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding , 2018, KDD.

[59]  Robert Kincaid,et al.  Line graph explorer: scalable display of line graphs using Focus+Context , 2006, AVI '06.

[60]  Gunther Heidemann,et al.  Inter-active learning of ad-hoc classifiers for video visual analytics , 2012, 2012 IEEE Conference on Visual Analytics Science and Technology (VAST).

[61]  Melanie Tory,et al.  Supporting Awareness through Collaborative Brushing and Linking of Tabular Data , 2013, IEEE Transactions on Visualization and Computer Graphics.

[62]  Dieter W. Fellner,et al.  Visual-Interactive Similarity Search for Complex Objects by Example of Soccer Player Analysis , 2017, VISIGRAPP.

[63]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[64]  Seiichi Uchida,et al.  A Comparative Evaluation of Unsupervised Anomaly Detection Algorithms for Multivariate Data , 2016, PloS one.

[65]  Tiejun Zhao,et al.  Self-adaptive statistical process control for anomaly detection in time series , 2016, Expert Syst. Appl..

[66]  Melanie Tory,et al.  Supporting Communication and Coordination in Collaborative Sensemaking , 2014, IEEE Transactions on Visualization and Computer Graphics.

[67]  Daniel A. Keim,et al.  Towards A Rigorous Evaluation Of XAI Methods On Time Series , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[68]  Yixin Chen,et al.  ECGLens: Interactive Visual Exploration of Large Scale ECG Data for Arrhythmia Detection , 2018, CHI.

[69]  Ching-Yung Lin,et al.  TargetVue: Visual Analysis of Anomalous User Behaviors in Online Communication Systems , 2016, IEEE Transactions on Visualization and Computer Graphics.

[70]  Silvia Miksch,et al.  A Visual Analytics Approach to Segmenting and Labeling Multivariate Time Series Data , 2014, EuroVA@EuroVis.

[71]  Petra Isenberg,et al.  Evaluation of alternative glyph designs for time series data in a small multiple setting , 2013, CHI.

[72]  Ejaz Ahmed,et al.  Real-time big data processing for anomaly detection: A Survey , 2019, Int. J. Inf. Manag..

[73]  Yu-Ru Lin,et al.  Voila: Visual Anomaly Detection and Monitoring with Streaming Spatiotemporal Data , 2018, IEEE Transactions on Visualization and Computer Graphics.

[74]  Meredith Ringel Morris,et al.  CoSearch: a system for co-located collaborative web search , 2008, CHI.