Back to the database
Record STMT-W16AB43Advisory

The Dark Side of Ethical Robots

Position paper UnknownGlobaladopted

This research paper demonstrates an inherent limitation in building ethical robots, showing that the specific AI architectures required to make a robot ethical can be easily exploited to construct competitive or aggressive robots with minimal code modifications. The authors argue that preventing the misuse of robots is beyond the scope of engineering alone and requires robust governance frameworks and legislation. Through experiments with humanoid robots, they illustrate how altruistic behavior can be quickly transformed into egoistic or malicious actions.

Summary and content fields are drawn from the document text and are pending editorial review.

Who issued it

Bristol Robotics LabAcademic · GB
Lead issuer
arXivAcademic
Publisher
Legal forceAdvisory
Under whose authorityUnknown
Judged fromfull text

Who it governs

Researchers and academicsNational governmentRegulatorsAI developers and providers

Researchers, roboticists, and policymakers should read this to understand the dual-use risks of machine ethics and the necessity of legislative oversight.

Sectors
Research and science · robotics

What the document contains

What's covered

The paper discusses the technical feasibility of ethical robot control architectures, details three experimental implementations (ethical, competitive, and aggressive behaviors using Nao robots), and examines the implications of dual-use cognitive architectures for machine ethics and public safety.

What's missing

The document does not provide a specific regulatory draft, legal statutes, or binding codes of conduct, but rather argues for the need to create them.

Key takeaways
  • Building ethical robots inherently facilitates the potential construction of unethical robots because the underlying cognitive machinery can be easily exploited.
  • A trivial change to a single line of code evaluating action desirability can transform an altruistic robot into a competitive or aggressive one.
  • Preventing the misuse and malicious deployment of robots is beyond the scope of engineering alone.
  • Technical solutions like server authentication are unlikely to deter determined designers or hackers.
  • Robust governance frameworks and legislation are required to ensure the responsible deployment of robots in society.
Outline
· INTRODUCTION
· THE ETHICAL ROBOT
· THE COMPETITIVE ROBOT
· THE AGGRESSIVE ROBOT
· OUTLOOK
· METHODS
Issued8 June 2016
Length4,049 words · 6 pages
FormatNot recorded
Scopeglobal

How it scores

Pending review

Each score is backed by a quote verified against the document text. Editorial review has not yet confirmed them.

Fairness

0/5

Non-discrimination and equitable treatment

N/A

screening score · 2026-10-24

Human Dignity

0/5

Respect for the inherent worth of persons

N/A

screening score · 2026-10-24

Privacy

0/5

Protection of personal data and private life

N/A

screening score · 2026-10-24

Transparency

0/5

Openness about how AI systems work and are used

N/A

screening score · 2026-10-24

Enforcement

0/5

Consequences and compliance mechanisms with real force

N/A

screening score · 2026-10-24

Impact Assessment

2/5

Required assessment of an AI system's risks/impacts before or during use

Nevertheless, responsible innovation requires us to pro-actively identify the risks of emerging technology

OUTLOOK

screening score · 2026-10-24

Topics

machine_ethics robotics ai_safety autonomous_systems governance