Multiple Adaptive Agents for Tactical Driving

Recent research in automated highway systems has ranged from low-level vision-based controllers to high-level route-guidance software. However, there is currently no system for tactical-level reasoning. Such a system should address tasks such as passing cars, making exits on time, and merging into a traffic stream. Many previous approaches have attempted to hand construct large rule-based systems which capture the interactions between multiple input sensors, dynamic and potentially conflicting subgoals, and changing roadway conditions. However, these systems are extremely difficult to design due to the large number of rules, the manual tuning of parameters within the rules, and the complex interactions between the rules. Our approach to this intermediate-level planning is a system which consists of a collection of autonomous agents, each of which specializes in a particular aspect of tactical driving. Each agent examines a subset of the intelligent vehicle's sensors and independently recommends driving decisions based on their local assessment of the tactical situation. This distributed framework allows different reasoning agents to be implemented using different algorithms.When using a collection of agents to solve a single task, it is vital to carefully consider the interactions between the agents. Since each reasoning object contains several internal parameters, manually finding values for these parameters while accounting for the agents' possible interactions is a tedious and error-prone task. In our system, these parameters, and the system's overall dependence on each agent, is automatically tuned using a novel evolutionary optimization strategy, termed Population-Based Incremental Learning (PBIL).Our system, which employs multiple automatically trained agents, can competently drive a vehicle, both in terms of the user-defined evaluation metric, and as measured by their behavior on several driving situations culled from real-life experience. In this article, we describe a method for multiple agent integration which is applied to the automated highway system domain. However, it also generalizes to many complex robotics tasks where multiple interacting modules must simultaneously be configured without individual module feedback.

[1]  Rich Caruana,et al.  Removing the Genetics from the Standard Genetic Algorithm , 1995, ICML.

[2]  Martin L Fracker,et al.  Explicit, Implicit, and Subjective Rating Measures of Situation Awareness in a Monitoring Task , 1991 .

[3]  Bruce H. Krogh,et al.  Integrated path planning and dynamic steering control for autonomous vehicles , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[4]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[5]  Takeo Kanade,et al.  Vision and Navigation for the Carnegie-Mellon Navlab , 1987 .

[6]  Keith Gardels AUTOMATIC CAR CONTROLS FOR ELECTRONIC HIGHWAYS , 1960 .

[7]  Rahul Sukthankar,et al.  Situation Awareness for Tactical Driving , 1997 .

[8]  Ronald C. Arkin,et al.  Using Genetic Algorithms to Learn Reactive Control Parameters for Autonomous Robotic Navigation , 1994, Adapt. Behav..

[9]  R. von Tomkewitsch,et al.  Dynamic route guidance and interactive transport management with ALI-SCOUT , 1991 .

[10]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[11]  A J McKnight,et al.  DRIVER EDUCATION TASK ANALYSIS. VOLUME 1: TASK DESCRIPTIONS , 1970 .

[12]  Shumeet Baluja,et al.  A Method for Integrating Genetic Search Based Function Optimization and Competitive Learning , 1994 .

[13]  E. D. Dickmanns,et al.  A Curvature-based Scheme for Improving Road Vehicle Guidance by Computer Vision , 1987, Other Conferences.

[14]  J. H. Rillings,et al.  Advanced driver information systems , 1990 .

[15]  Charles E. Thorpe,et al.  A Simulation and Design System for Tactical Driving Algorithms , 1996 .

[16]  S A Schupack,et al.  AN EVALUATION OF THE NATIONAL SAFETY COUNCIL'S DEFENSIVE DRIVING COURSE AS AN ADJUNCT TO HIGH SCHOOL DRIVER EDUCATION PROGRAMS, PART II , 1975 .

[17]  James F. Cremer,et al.  The Software Architecture for Scenario Control in the Iowa Driving Simulator , 1993 .

[18]  C. Vision-based Vehicle Guidance , 1992, Springer Series in Perception Engineering.

[19]  Dean A. Pomerleau,et al.  SHIVA: Simulated Highways for Intelligent Vehicle Algorithms , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[20]  Dean A. Pomerleau,et al.  Neural Network Perception for Mobile Robot Guidance , 1993 .

[21]  Nadine B. Sarter,et al.  How in the World Did We Ever Get into That Mode? Mode Error and Awareness in Supervisory Control , 1995, Hum. Factors.

[22]  Steven A. Shafer,et al.  Selective Perception for Robot Driving , 1993, AAAI.

[23]  John A. Michon,et al.  A critical view of driver behavior models: What do we know , 1985 .