Can I read Who is Responsible? Explaining Safety Violations in Multi-Agent Cyber-Physical Systems on EtoBox?

Who is Responsible? Explaining Safety Violations in Multi-Agent Cyber-Physical Systems by Niu, Luyao; Zhang, Hongchao; Sahabandu, Dinuka; Ramasubramanian, Bhaskar; Clark, Andrew; Poovendran, Radha is a scholarly article available to read on EtoBox.

What is Who is Responsible? Explaining Safety Violations in Multi-Agent Cyber-Physical Systems about?

Multi-agent cyber-physical systems are present in a variety of applications. Agent decision-making can be affected due to errors induced by uncertain, dynamic operating environments or due to incorrect actions taken by an agent. When an erroneous decision that leads to a violation of safety is identified, assigning responsibility to individual agents is a key step toward preventing future accidents. Current approaches to carrying out such investigations require human labor or high degree of familiarity with operating environments. Automated strategies to assign responsibility can achieve a significant reduction in human effort and associated cognitive burden. In this paper, we develop an automated procedure to assign responsibility for safety violations to actions of any single agent in a principled manner. We base our approach on reasoning about safety violations in road safety. Given a safety violation, we use counterfactual reasoning to create alternative scenarios, showing how different outcomes could have occurred if certain actions had been replaced by others. We introduce the degree of responsibility (DoR) metric for each agent. The DoR, using the Shapley value, quantifies e

Author

Niu, Luyao; Zhang, Hongchao; Sahabandu, Dinuka; Ramasubramanian, Bhaskar; Clark, Andrew; Poovendran, Radha

Published

2024

Language

EN