Computational Accountability M. Baldoni, C. Baroglio , K. M. May, R. Micalizio and S. Tedeschi 1 1 Universit` a degli Studi di Torino Genova, Nov. 28th, 2016 BBMMT (UniTO) Genova, Nov. 28th, 2016 1 / 20 URANIA 2016
Ubiquitous AI AI methodologies and techniques: are raising greater and greater attention are practically used in sensitive fields: search engines, electronic markets, smart homes, military, data analysis, self-driving cars, ... The research community is discussing the ethical implications Two main perspectives have emerged ... BBMMT (UniTO) Genova, Nov. 28th, 2016 2 / 20 URANIA 2016
Ubiquitous AI AI methodologies and techniques: are raising greater and greater attention are practically used in sensitive fields: search engines, electronic markets, smart homes, military, data analysis, self-driving cars, ... The research community is discussing the ethical implications Two main perspectives have emerged ... BBMMT (UniTO) Genova, Nov. 28th, 2016 2 / 20 URANIA 2016
Main lines: ethical concerns about Adoption of AI techniques and Design and application of methodologies artificially intelligent systems impact of AI on work and Machine ethics: moral other aspects of our lives: behavior of artificially threat to or saviour for intelligent beings humanity? Roboethics: moral behavior safeguards necessary within of humans as they design, AI research (applications in construct, use artifically the military, commerce, ...) intelligent beings BBMMT (UniTO) Genova, Nov. 28th, 2016 3 / 20 URANIA 2016
Testimonies AAAI 2016 WS on AI, Ethics and Society; IJCAI 2016 WS on Ethics in Artificial Intelligence; ECAI 2016 WS on Ethics in the Design of Intelligent Agents; Guide to the ethical design and application of robots and robotic systems (BS 8611:2016 standard); ETHICAA project: “Machines and software acting on behalf of humans get more autonomy and are increasingly less under the control of human operators or users [...] the question of an ethical regulation and control of autonomous agents is raised.” BBMMT (UniTO) Genova, Nov. 28th, 2016 4 / 20 URANIA 2016
A third perspective: Computational Accountability AI as a tool that supports the realization of ethical business through the traceability , evaluation , and communication of values and good conduct “We need an inclusive, robust yet flexible accountability framework ”, Ban Ki-moon, Secretary-General of the United Nations, 2014 What is accountability? Why is it a complex problem to solve? Why AI? BBMMT (UniTO) Genova, Nov. 28th, 2016 5 / 20 URANIA 2016
A third perspective: Computational Accountability AI as a tool that supports the realization of ethical business through the traceability , evaluation , and communication of values and good conduct “We need an inclusive, robust yet flexible accountability framework ”, Ban Ki-moon, Secretary-General of the United Nations, 2014 What is accountability? Why is it a complex problem to solve? Why AI? BBMMT (UniTO) Genova, Nov. 28th, 2016 5 / 20 URANIA 2016
A third perspective: Computational Accountability AI as a tool that supports the realization of ethical business through the traceability , evaluation , and communication of values and good conduct “We need an inclusive, robust yet flexible accountability framework ”, Ban Ki-moon, Secretary-General of the United Nations, 2014 What is accountability? Why is it a complex problem to solve? Why AI? BBMMT (UniTO) Genova, Nov. 28th, 2016 5 / 20 URANIA 2016
What is Accountability? Ontological views, e.g.: accountability is the intersection between responsibility and answerability Societies develop models of responsibility Definitions vary in approach and scope and different communities do not share a same understanding In English Responsible: who does Accountable: who signs off (the account giver) BBMMT (UniTO) Genova, Nov. 28th, 2016 6 / 20 URANIA 2016
What is Accountability? Ontological views, e.g.: accountability is the intersection between responsibility and answerability Societies develop models of responsibility Definitions vary in approach and scope and different communities do not share a same understanding In English Responsible: who does Accountable: who signs off (the account giver) BBMMT (UniTO) Genova, Nov. 28th, 2016 6 / 20 URANIA 2016
A characterization of accountability To trace, evaluate, and communicate the value of accountability we need a more “operational” characterization, that sets accountability inside processes, associates it to individuals and roles, etc. Accountability is a composition of processes Accountability does not hinder autonomy Accountability implies agency Accountability implies causation Accountability implies significance A system of accountability must be sound and complete [Burgemeestre and Hulstijn, 2015, Yazdanpanah and Dastani, 2016] BBMMT (UniTO) Genova, Nov. 28th, 2016 7 / 20 URANIA 2016
A characterization of accountability To trace, evaluate, and communicate the value of accountability we need a more “operational” characterization, that sets accountability inside processes, associates it to individuals and roles, etc. Accountability is a composition of processes Accountability does not hinder autonomy Accountability implies agency Accountability implies causation Accountability implies significance A system of accountability must be sound and complete [Burgemeestre and Hulstijn, 2015, Yazdanpanah and Dastani, 2016] BBMMT (UniTO) Genova, Nov. 28th, 2016 7 / 20 URANIA 2016
A characterization of accountability Accountability is a composition of processes : identification, judgement, sanction Accountability does not hinder autonomy : an accountable agent has complete freedom but later may requested to account for Accountability implies agency : agents are accountable, tools are not Accountability implies causation : (in)action of the accountable party causes the situation to verify Accountability implies significance : judgement (guilty/not guilty) must consider the degree to which the action of the accountable party was significant in creating the unwanted situation A system of accountability must be sound and complete : only faulty agents will be blamed, all faulty agents will be identified BBMMT (UniTO) Genova, Nov. 28th, 2016 8 / 20 URANIA 2016
Accountability a complex problem? Need AI? Ted and Bill are painters, called by Jim for painting a room The walls are white, Jim would like to have them painted of the same color Ted makes a better offer and gets the job Bill, in the night, paints the walls black Ted will not be able to satisfy his commitment with Jim! He needs to use twice as much paint as expected at a much higher cost BBMMT (UniTO) Genova, Nov. 28th, 2016 9 / 20 URANIA 2016
Accountability a complex problem? Need AI? Ted is unable to fulfill the contract: is he accountable? Conditions changed in a hardly predictable way Contextual conditions that hardly change over time are presumed implicitly stipulated even when they are not formalized Is Jim accountable? The door may have been left unlocked Can the real responsible be considered in deciding who is accountable? BBMMT (UniTO) Genova, Nov. 28th, 2016 10 / 20 URANIA 2016
Beyond Ted, Bill, and Jim For firms, business ethics and compliance programs are becoming critical and the realization of accountability systems is crucial Modern enterprises [Bridgeland and Zahavi, 2008] are: A further aspect is complex and distributed because dynamicity: people they involve offices, activities, are hired/fired, actors, resources, often promoted, offices heterogeneous, geographically are restructured, distributed, and dependant on one moved, stakeholders another; change, ..., who is aleatory because they are affected accountable? by unpredictable events like new laws, market trends, incidents BBMMT (UniTO) Genova, Nov. 28th, 2016 11 / 20 URANIA 2016
Beyond Ted, Bill, and Jim For firms, business ethics and compliance programs are becoming critical and the realization of accountability systems is crucial However, methodologies and tools for designing business processes and workflow engines do not yet support the realization of accountability systems BBMMT (UniTO) Genova, Nov. 28th, 2016 12 / 20 URANIA 2016
AI and accountability How to represent and manipulate responsibilities? Something goes wrong, who is accountable? How to distribute responsibilities to workers? How to coordinate workers with different responsibilities? Knowledge representation (delegation, release, ...) Reasoning about the past, looking for causes (diagnosis) Reasoning about the future: construction of individual or joint plans BBMMT (UniTO) Genova, Nov. 28th, 2016 13 / 20 URANIA 2016
AI and accountability How to represent and manipulate responsibilities? Something goes wrong, who is accountable? How to distribute responsibilities to workers? How to coordinate workers with different responsibilities? Knowledge representation (delegation, release, ...) Reasoning about the past, looking for causes (diagnosis) Reasoning about the future: construction of individual or joint plans BBMMT (UniTO) Genova, Nov. 28th, 2016 13 / 20 URANIA 2016
Pathway to accountability BBMMT (UniTO) Genova, Nov. 28th, 2016 14 / 20 URANIA 2016
Recommend
More recommend
