Overriding Ethical Constraints in Lethal Autonomous Systems

Abstract : This article describes the philosophy, design, and prototype implementation of an operator override system intended for use in managing unmanned robotic systems capable of lethal behavior. The ethical ramifications associated with the responsibility assignment of such a system are presented, which guide the development of the proof-of-concept system that serves as the basis for the simulation results presented herein.

[1]  Peter Asaro,et al.  How Just Could a Robot War Be , 2008 .

[2]  Ronald C. Arkin,et al.  An Ethical Governor for Constraining Lethal Action in an Autonomous System , 2009 .

[3]  James H. Toner.  Military OR Ethics , 2003 .

[4]  Andreas Matthias,et al.  The responsibility gap: Ascribing responsibility for the actions of learning automata , 2004, Ethics and Information Technology.

[5]  Ronald C. Arkin,et al.  Multiagent Mission Specification and Execution , 1997, Auton. Robots.

[6]  R. D. Alexander,et al.  A Critique of the " Unmanned Systems Safety Guide for Dod Acquisition " , 2009 .

[7]  Ronald C. Arkin,et al.  Lethality and autonomous systems: The roboticist demographic , 2008, 2008 IEEE International Symposium on Technology and Society.

[8]  M. Walzer.  Just and Unjust Wars , 1977 .

[9]  Larry May,et al.  The Morality of War: Classical and Contemporary Readings , 2005 .

[10]  Ronald C. Arkin,et al.  Governing lethal behavior: Embedding ethics in a hybrid deliberative/reactive robot architecture part I: Motivation and philosophy , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[11]  Ronald C. Arkin,et al.  Governing Lethal Behavior in Autonomous Robots , 2009 .

[12]  Ronald C. Arkin.  Governing Lethal Behavior: Embedding Ethics in a Hybrid Deliberative/Reactive Robot Architecture - Part 2: Formalization for Ethical Control , 2008, AGI.

[13]  Alan R. Wagner,et al.  Responsibility and Lethality for Unmanned Systems: Ethical Pre-mission Responsibility Advisement , 2009 .

[14]  Larry May,et al.  Crimes Against Humanity: Superior Orders, Duress, and Moral Perception , 2004 .

[15]  Hamilton DeSaussure,et al.  International Law--The Conduct of Armed Conflict and Air Operations. , 1978, American Journal of International Law.

[16]  Mark S. Martins.  Rules of Engagement for Land Forces: A Matter of Training, Not Lawyering Volume 143 , 1994 .

[17]  Ronald C. Arkin,et al.  An ethical adaptor: Behavioral modification derived from moral emotions , 2009, 2009 IEEE International Symposium on Computational Intelligence in Robotics and Automation - (CIRA).

[18]  Perri.  Ethics, regulation and the new artificial intelligence, part II: autonomy and liability , 2001 .