The surprising efficiency of framing geo-spatial time series forecasting as a video prediction task - Insights from the IARAI Traffic4cast Competition at NeurIPS 2019

Deep Neural Networks models are state-of-the-art solutions in accurately forecasting future video frames in a movie. A successful video prediction model needs to extract and encode semantic features that describe the complex spatio-temporal correlations within image sequences of the real world. The IARAI Traffic4cast Challenge of the NeurIPS Competition Track 2019 for the first time introduced the novel argument that this is also highly relevant for urban traffic. By framing traffic prediction as a movie completion task, the challenge requires models to take advantage of complex geo-spatial and temporal patterns of the underlying process. We here report on the success and insights obtained in a first Traffic Map Movie forecasting challenge. Although short-term traffic prediction is considered hard, this novel approach allowed several research groups to successfully predict future traffic states in a purely data-driven manner from pixel space. We here expand on the original ratio∗ Work performed at SEAT, S.A. c © 2020 D.P. Kreil et al. Efficiency of framing geo-spatial time series forecasting as a video prediction task nale, summarize key findings, and discuss promising future directions of the Traffic4cast competition at NeurIPS.

[1]  L. Anselin What is Special About Spatial Data? Alternative Perspectives on Spatial Data Analysis (89-4) , 1989 .

[2]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[3]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[4]  Silvia Nittel,et al.  A Survey of Geosensor Networks: Advances in Dynamic Environmental Monitoring , 2009, Sensors.

[5]  Stephen Dunne,et al.  Regime-Based Short-Term Multivariate Traffic Condition Forecasting Algorithm , 2012 .

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Nitish Srivastava,et al.  Unsupervised Learning of Video Representations using LSTMs , 2015, ICML.

[8]  Jiajun Wu,et al.  Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks , 2016, NIPS.

[9]  Martial Hebert,et al.  An Uncertain Future: Forecasting from Static Images Using Variational Autoencoders , 2016, ECCV.

[10]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  David M Levinson,et al.  Spatiotemporal traffic forecasting: review and proposed directions , 2018 .

[12]  Eleni I. Vlahogianni,et al.  Road Traffic Forecasting: Recent Advances and New Challenges , 2018, IEEE Intelligent Transportation Systems Magazine.

[13]  Martin Raubal,et al.  Identifying and Interpreting Clusters of Persons with Similar Mobility Behaviour Change Processes , 2018, AGILE Conf..

[14]  Sergey Levine,et al.  Stochastic Adversarial Video Prediction , 2018, ArXiv.

[15]  Andrew Zisserman,et al.  Video Representation Learning by Dense Predictive Coding , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[16]  Martin Raubal,et al.  From location tracking to personalized eco-feedback: A framework for geographic information collection, processing and visualization to promote sustainable mobility behaviors , 2019, Travel Behaviour and Society.

[17]  R. Buffat,et al.  Traffic4cast-Traffic Map Movie Forecasting - Team MIE-Lab , 2019, ArXiv.

[18]  Ning Feng,et al.  Attention Based Spatial-Temporal Graph Convolutional Networks for Traffic Flow Forecasting , 2019, AAAI.

[19]  Sanja Fidler,et al.  CrevNet: Conditionally Reversible Video Prediction , 2019, ArXiv.

[20]  Henry Martin,et al.  Graph-ResNets for short-term traffic forecasts in almost unknown cities , 2020, NeurIPS.

[21]  David M Levinson,et al.  Spatiotemporal short-term traffic forecasting using the network weight matrix and systematic detrending , 2019, Transportation Research Part C: Emerging Technologies.

[22]  Sungbin Choi,et al.  Traffic map prediction using UNet based deep convolutional neural network , 2019, ArXiv.

[23]  Jason Hickey,et al.  Machine Learning for Precipitation Nowcasting from Radar Images , 2019, ArXiv.

[24]  Pedro Herruzo,et al.  Recurrent Autoencoder with Skip Connections and Exogenous Variables for Traffic Forecasting , 2019, NeurIPS.

[25]  Min-Gyu Park,et al.  Predicting Future Frames Using Retrospective Cycle GAN , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Sanja Fidler,et al.  Efficient and Information-Preserving Future Frame Prediction and Beyond , 2020, ICLR.