Governing Lethal Behavior in Autonomous Robots

Drawing from the authors own state-of-the-art research, this book examines the philosophical basis, motivation, theory, and design recommendations for the implementation of an ethical control and reasoning system in autonomous robot systems, taking into account the Laws of War and Rules of Engagement. It discusses how robots can ultimately be more humane than humans in the battlefield. The author addresses the issue of autonomous robots having the potential to make life-or-death decisions and provides examples that illustrate autonomous systems ethical use of force. He also includes the opinions of the public, researchers, policymakers, and military personnel on the use of lethality by autonomous systems.

[1]  Yoram Dinstein,et al.  Legitimate Military Objectives under the Current Jus in Bello , 2001, Israel Yearbook on Human Rights, Volume 31 (2001).

[2]  Peter Asaro,et al.  How Just Could a Robot War Be , 2008 .

[3]  R. Swank,et al.  Combat neuroses; development of combat exhaustion. , 1946, Archives of neurology and psychiatry.

[4]  Robert Sparrow,et al.  Building a Better WarBot: Ethical Issues in the Design of Unmanned Systems for Military Applications , 2009, Sci. Eng. Ethics.

[5]  Justine Johnstone,et al.  Technology as empowerment: a capability approach to computer ethics , 2007, Ethics and Information Technology.

[6]  Zsolt Kira,et al.  Forgetting Bad Behavior: Memory Management for Case-Based Navigation , 2004 .

[7]  Thomas M. Powers.  Prospects for a Kantian Machine , 2006, IEEE Intelligent Systems.

[8]  Gaurav S. Sukhatme,et al.  Adaptive teams of autonomous aerial and ground robots for situational awareness , 2007, J. Field Robotics.

[9]  Geoffrey Robertson,et al.  Crimes Against Humanity , 2008 .

[10]  Jean Bethke Elshtain,et al.  Just war theory , 1992 .

[11]  Thomas K. Adams.  Future Warfare and the Decline of Human Decisionmaking , 2001, The US Army War College Quarterly: Parameters.

[12]  James H. Toner.  Military OR Ethics , 2003 .

[13]  Ronald C. Arkin,et al.  Lethality and autonomous systems: The roboticist demographic , 2008, 2008 IEEE International Symposium on Technology and Society.

[14]  Wendell Wallach,et al.  Why Machine Ethics? , 2006, IEEE Intelligent Systems.

[15]  Susan Leigh Anderson,et al.  Asimov’s “three laws of robotics” and machine metaethics , 2008, AI & SOCIETY.

[16]  Ronald C. Arkin,et al.  Tactical mobile robot mission specification and execution , 1999, Optics East.

[17]  Ronald C. Arkin,et al.  On TAMEing robots , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[18]  Ronald C. Arkin,et al.  Learning behavioral parameterization using spatio-temporal case-based reasoning , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[19]  J. Grafman,et al.  The neural basis of human moral cognition , 2005, Nature Reviews Neuroscience.

[20]  James E. Baker.  Judging Kosovo: The Legal Process, the Law of Armed Conflict, and the Commander in Chief , 2002 .

[21]  Richard Strayer,et al.  Vietnam Veterans: A Study Exploring Adjustment Patterns and Attitudes , 1975 .

[22]  Bruce M. McLaren,et al.  Lessons in Machine Ethics from the Perspective of Two Computational Models of Ethical Reasoning , 2005 .

[23]  Ronald C. Arkin,et al.  Human perspective on affective robotic behavior: a longitudinal study , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  John J. Klein,et al.  The Problematic Nexus: Where Unmanned Combat Air Vehicles and the Law of Armed Conflict Meet , 2003 .

[25]  Cao Lai-f.  Global Information Grid , 2005 .

[26]  Perri.  Ethics, regulation and the new artificial intelligence, part II: autonomy and liability , 2001 .

[27]  Ronald C. Arkin,et al.  Usability evaluation of high-level user assistance for robot mission specification , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[28]  Mark S. Martins.  Rules of Engagement for Land Forces: A Matter of Training, Not Lawyering Volume 143 , 1994 .

[29]  Gert-Jan C. Lokhorst,et al.  Deontic Logic and Computer‐Supported Computer Ethics , 2002 .

[30]  W. Maner.  Heuristic Methods for Computer Ethics , 2002 .

[31]  Ronald C. Arkin,et al.  Multiagent Mission Specification and Execution , 1997, Auton. Robots.

[32]  John P. Sullins.  When Is a Robot a Moral Agent , 2006 .

[33]  R. Arkin.  Moving Up the Food Chain: Motivation and Emotion in Behavior-Based Robots , 2003 .

[34]  Eric Krotkov,et al.  The Defense Advanced Research Projects Agency (DARPA) Tactical Mobile Robotics Program , 1999, Int. J. Robotics Res..

[35]  Larry May,et al.  Crimes Against Humanity: Superior Orders, Duress, and Moral Perception , 2004 .

[36]  R. Thurston,et al.  A History of the Growth of the Steam-Engine , 1879, Nature.

[37]  Paul Woodruff,et al.  Justification or Excuse: Saving Soldiers at the Expense of Civilians , 1982 .

[38]  James H. Moor,et al.  The Nature, Importance, and Difficulty of Machine Ethics , 2006, IEEE Intelligent Systems.

[39]  Andreas Matthias,et al.  The responsibility gap: Ascribing responsibility for the actions of learning automata , 2004, Ethics and Information Technology.

[40]  Ronald C. Arkin,et al.  Lethality and Autonomous Systems: Survey Design and Results , 2007 .

[41]  Ronald C. Arkin,et al.  Modeling neural function at the schema level: implications and results for robotic control , 1993 .

[42]  Selmer Bringsjord,et al.  Toward a General Logicist Methodology for Engineering Ethically Correct Robots , 2006, IEEE Intelligent Systems.

[43]  Christopher Grau,et al.  There Is No "I" in "Robot": Robots and Utilitarianism , 2006, IEEE Intelligent Systems.

[44]  Bruce M. McLaren,et al.  Computational Models of Ethical Reasoning: Challenges, Initial Steps, and Future Directions , 2006, IEEE Intelligent Systems.

[45]  Jason Borenstein.  The Ethics of Autonomous Military Robots , 2008 .

[46]  J. Kumagai,et al.  A Robotic Sentry For Korea's Demilitarized Zone , 2007, IEEE Spectrum.

[47]  Kari Gwen Coleman,et al.  Android arete: Toward a virtue ethic for computational agents , 2002, Ethics and Information Technology.

[48]  Walter A. Aviles.  Issues in Mobile robotics: The Unmanned Ground Vehicle Program TeleOperated Vehicle , 1990 .

[49]  Noel E. Sharkey,et al.  Cassandra or False Prophet of Doom: AI Robots and War , 2008, IEEE Intelligent Systems.

[50]  Bring.  International Humanitarian Law after Kosovo: Is lex lata Sufficient? , 2002 .

[51]  Tucker R. Balch,et al.  AuRA: principles and practice in review , 1997, J. Exp. Theor. Artif. Intell..

[52]  Michael Anderson,et al.  An Approach to Computing Ethics , 2006, IEEE Intelligent Systems.

[53]  G. J. C. Lokhorst,et al.  Privacy, Deontic Epistemic Action Logic and Software Agents , 2006, Ethics and Information Technology.

[54]  Franz B. Schick.  Crimes against Peace , 1948 .

[55]  Ronald C. Arkin,et al.  Selection of behavioral parameters: integration of discontinuous switching via case-based reasoning with continuous adaptation via learning momentum , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[56]  Shlomo Zilberstein,et al.  Using Anytime Algorithms in Intelligent Systems , 1996, AI Mag..

[57]  Niess Ok,et al.  Psychiatric screening of combat pilots. , 1956 .

[58]  Joy Bill,et al.  Why the future doesn’t need us , 2003 .

[59]  Marcello Guarini,et al.  Particularism and the Classification and Reclassification of Moral Cases , 2006, IEEE Intelligent Systems.

[60]  J. Tangney,et al.  Moral emotions and moral behavior. , 2007, Annual review of psychology.

[61]  J. Hughes,et al.  First Do No Harm: Adverse Effects of Grouping Deviant Youth for Skills Training , 1999 .

[62]  Matteo Turilli,et al.  Ethical protocols design , 2007, Ethics and Information Technology.

[63]  K. Himma.  Artificial agency, consciousness, and the criteria for moral agency: what properties must an artificial agent have to be a moral agent? , 2009, Ethics and Information Technology.

[64]  Ted Humphrey,et al.  Perpetual peace, and other essays : on politics, history, and morals , 1983 .

[65]  Tucker R. Balch,et al.  Behavior-based formation control for multirobot teams , 1998, IEEE Trans. Robotics Autom..

[66]  L. Calhoun,et al.  The Strange Case of Summary Execution by Predator Drone , 2003 .

[67]  Paul De Boeck,et al.  A Componential IRT Model for Guilt , 2003 .

[68]  John H. Yoder,et al.  When War Is Unjust: Being Honest in Just-War Thinking , 1984 .

[69]  Ronald C. Arkin,et al.  Neuroscience in Motion: The Application of Schema Theory to Mobile Robotics , 1989 .

[70]  Ronald C. Arkin,et al.  Field Results for Tactical Mobile Robot Missions , 2000 .

[71]  Noel E. Sharkey,et al.  Automated Killers and the Computing Profession , 2007, Computer.

[72]  James Guttman.  Shoot first -- ask questions later , 2008 .

[73]  Bruce M. McLaren,et al.  Extensionally defining principles and cases in ethics: An AI model , 2003, Artif. Intell..

[74]  J. Haidt,et al.  The Moral Emotions , 2009 .

[75]  J. D. Hightower,et al.  Development of Remote Presence Technology for Teleoperator Systems , 1986 .

[76]  Masahiro Fujita,et al.  An ethological and emotional basis for human-robot interaction , 2003, Robotics Auton. Syst..

[77]  Ronald C. Arkin,et al.  Integrated Mission Specification and Task Allocation for Robot Teams - Design and Implementation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.