Efficient discovery of spatial associations and structure with application to asteroid tracking

The problem of finding sets of points that conform to a given underlying spatial model is a conceptually simple, but potentially expensive, task that arises in a variety of domains. The goal is simply to find occurrences of known types of spatial structure in the data. However, as we begin to examine large, dense, and noisy data sets the cost of finding such occurrences can increase rapidly. In this thesis I consider the computational issues inherent in extracting model-based spatial associations and structure from large amounts of noisy data. In particular, I discuss the development of new techniques and algorithms that mitigate or eliminate these computational issues. I show that there are several different types of structure in both the data and the problem itself that can often be exploited to this end. Primarily, I describe a new type of tree-based search algorithm that uses a variable number of tree nodes to adapt to both structure in the data and search state itself. While the problem of finding known types of spatial structure arises in a wide range of domains, the primary motivating problem throughout this thesis is the task of asteroid linkage and tracking. Here the goal is to link together individual point observations in order to find and extract new asteroid trajectories in the data. Ultimately, the goal is to identify and track all asteroids that are large enough to penetrate the earth's atmosphere and cause significant damage upon impact. Future astronomical surveys will provide a wealth of observational data to this end, greatly increasing both the ability to find new objects and the scale of the problem. Thus efficient algorithms are vital to effectively handle the massive amount of data that is expected.

[1]  Andrew W. Moore,et al.  Variable KD-Tree Algorithms for Spatial Pattern Search and Discovery , 2005, NIPS.

[2]  Andrew W. Moore,et al.  A multiple tree algorithm for the efficient association of asteroid observations , 2005, KDD '05.

[3]  Andrew J. Connolly,et al.  Efficiently identifying close track/observation pairs in continuous timed data , 2005, SPIE Optics + Photonics.

[4]  Walter A. Siegmund,et al.  Design of the Pan‐STARRS telescopes , 2004 .

[5]  A. Milani,et al.  Orbit determination with very short arcs. I admissible regions , 2004 .

[6]  Brett James Gladman,et al.  A highly automated moving object detection package , 2004 .

[7]  Clark F. Olson,et al.  A General Method for Geometric Feature Matching and Model Extraction , 2001, International Journal of Computer Vision.

[8]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[9]  Donald W. Sweeney,et al.  An Overview of the Large Synoptic Survey Telescope (LSST) System , 2004 .

[10]  Andrew W. Moore,et al.  Spatial Data Structures for Efficient Trajectory-Based Queries , 2004 .

[11]  David Jewitt,et al.  Project Pan-STARRS and the Outer Solar System , 2003 .

[12]  K. Muinonen,et al.  Orbit computation for transneptunian objects , 2003 .

[13]  Christopher K. I. Williams,et al.  Renewal Strings for Cleaning Astronomical Databases , 2002, UAI.

[14]  Robert Jedicke,et al.  Earth and space-based NEO survey simulations: prospects for achieving the Spaceguard Goal , 2003 .

[15]  Dimitrios Gunopulos,et al.  Indexing mobile objects on the plane , 2002, Proceedings. 13th International Workshop on Database and Expert Systems Applications.

[16]  Robert Jedicke,et al.  From Magnitudes to Diameters: The Albedo Distribution of Near Earth Objects and the Earth Collision Hazard , 2002 .

[17]  Karri Muinonen,et al.  Statistical Ranging of Asteroid Orbits , 2001 .

[18]  J. S. Stuart,et al.  A Near-Earth Asteroid Population Estimate from the LINEAR Survey , 2001, Science.

[19]  S. Chesley,et al.  The Asteroid Identification Problem IV: Attributions , 2001 .

[20]  Clark F. Olson,et al.  Locating geometric primitives by pruning the parameter space , 2001, Pattern Recognit..

[21]  R. Jedicke,et al.  The Spacewatch Wide-Area Survey for Bright Centaurs and Trans-Neptunian Objects , 2001 .

[22]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[23]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[24]  Christian S. Jensen,et al.  Indexing the positions of continuously moving objects , 2000, SIGMOD '00.

[25]  Dinesh Manocha,et al.  Fast distance queries with rectangular swept sphere volumes , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[26]  Jedicke,et al.  Understanding the distribution of near-earth asteroids , 1999, Science.

[27]  Dieter Pfoser,et al.  Novel Approaches to the Indexing of Moving Object Trajectories , 2000, VLDB.

[28]  Andrew W. Moore,et al.  'N-Body' Problems in Statistical Learning , 2000, NIPS.

[29]  Alexander S. Szalay,et al.  The Sloan Digital Sky Survey , 1999, Comput. Sci. Eng..

[30]  Andrea Milani,et al.  The Asteroid Identification Problem: I. Recovery of Lost Asteroids☆ , 1999 .

[31]  Bruce Margony The Sloan Digital Sky Survey , 1999, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[32]  Hanan Samet,et al.  Incremental distance join algorithms for spatial databases , 1998, SIGMOD '98.

[33]  R. Jedicke,et al.  The Orbital and Absolute Magnitude Distributions of Main Belt Asteroids , 1998, astro-ph/9801023.

[34]  Ming C. Lin,et al.  Collision Detection between Geometric Models: A Survey , 1998 .

[35]  Pavel Zezula,et al.  M-tree: An Efficient Access Method for Similarity Search in Metric Spaces , 1997, VLDB.

[36]  Dinesh Manocha,et al.  OBBTree: a hierarchical structure for rapid interference detection , 1996, SIGGRAPH.

[37]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[38]  Philip M. Hubbard,et al.  Collision Detection for Interactive Graphics Applications , 1995, IEEE Trans. Vis. Comput. Graph..

[39]  S. W. Shaw,et al.  Design and implementation of a fully automated OTH radar tracking system , 1995, Proceedings International Radar Conference.

[40]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[41]  David Morrison,et al.  Impacts on the Earth by asteroids and comets: assessing the hazard , 1994, Nature.

[42]  Alan Watt,et al.  3D Computer Graphics , 1993 .

[43]  T. Breuel Recognition by Adaptive Subdivision of Transformation Space: practical experiences and comparison with the Hough transform , 1993 .

[44]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[45]  Erkki Oja,et al.  Randomized hough transform (rht) : Basic mech-anisms, algorithms, and computational complexities , 1993 .

[46]  C. Chyba,et al.  The 1908 Tunguska explosion: atmospheric disruption of a stony asteroid , 1993, Nature.

[47]  Violet F. Leavers,et al.  The dynamic generalized Hough transform: Its relationship to the probabilistic Hough transforms and an application to the concurrent detection of circles and ellipses , 1992, CVGIP Image Underst..

[48]  L. Kristensen The identification problem in asteroid surveys , 1992 .

[49]  Jeffrey K. Uhlmann,et al.  Satisfying General Proximity/Similarity Queries with Metric Trees , 1991, Inf. Process. Lett..

[50]  B. G. Marsden,et al.  The computation of orbits in indeterminate and uncertain cases , 1991 .

[51]  A. Kashlinsky,et al.  Large-scale structure in the Universe , 1991, Nature.

[52]  Oliver Montenbruck,et al.  Astronomy on the personal computer , 1991 .

[53]  Dimitri P. Bertsekas,et al.  The Auction Algorithm for Assignment and Other Network Flow Problems , 1990 .

[54]  Erkki Oja,et al.  A new curve detection method: Randomized Hough transform (RHT) , 1990, Pattern Recognit. Lett..

[55]  Josef Kittler,et al.  A comparison of Hough transform methods , 1989 .

[56]  Josef Kittler,et al.  A hierarchical approach to line extraction , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[57]  R. Shorter Asteroids. Their Nature and Utilization , 1989 .

[58]  Josef Kittler,et al.  A survey of the hough transform , 1988, Comput. Vis. Graph. Image Process..

[59]  James Arvo,et al.  Fast ray tracing by ray classification , 1987, SIGGRAPH '87.

[60]  Josef Kittler,et al.  The Adaptive Hough Transform , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[61]  Hungwen Li,et al.  Fast Hough transform: A hierarchical approach , 1986, Comput. Vis. Graph. Image Process..

[62]  Andrew S. Glassner,et al.  Space subdivision for fast ray tracing , 1984, IEEE Computer Graphics and Applications.

[63]  Antonin Guttman,et al.  R-trees: a dynamic index structure for spatial searching , 1984, SIGMOD '84.

[64]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[65]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[66]  D. Reid An algorithm for tracking multiple targets , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[67]  Y. Bar-Shalom,et al.  Tracking in a cluttered environment with probabilistic data association , 1975, Autom..

[68]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[69]  P. R. Escobal,et al.  Methods of orbit determination , 1976 .

[70]  P.V.C. Hough,et al.  Machine Analysis of Bubble Chamber Pictures , 1959 .