AI decision-making

Definition & Introduction

AI decision-making refers to processes where artificial intelligence (AI) systems provide guidance or input to help humans make choices. In some of these processes, AI plays a more supportive role where outputs are reviewed and analyzed by humans prior to arriving at any conclusion. But as AI systems evolve, their role in decision-making processes can become more significant, introducing novel ethical concerns.

AI decision-making is in use across many fields and applications including:

  • Healthcare: AI assists medical professionals in diagnosing diseases by analyzing lab results and patient histories.
  • Finance: AI algorithms assess creditworthiness and are used in fraud detection.
  • Politics: AI agents influence formal and informal deliberative processes like citizen assemblies and the spreading of ideas in digital spaces.
  • Sales: AI tools within customer data platforms can automate prospecting based on buyer intent.
  • Policing: Data fusion systems, leveraging AI, enable police to develop sophisticated hypotheses about who may or may not have committed a crime.

Explore the resources below for more on the ethical challenges connected to AI decision-making.

Risking Escalation for the Sake of Efficiency: Ethical Implications of AI Decision-Making in Conflicts

Stanford University's Max Lamparth analyzes the potential for AI decision-making in strategic military contexts and shares insights from two research projects regarding the escalatory tendencies of large language models.

Read the article

More Resources on AI Decision-Making

NOV 13, 2024 Article

An Ethical Grey Zone: AI Agents in Political Deliberations

SEP 12, 2024 Article

From Principles to Action: Charting a Path for Military AI Governance

As AI reshapes war's ethical dimensions, stakeholders must work together on greater transparency and governance efforts for this emerging technology, writes Dr. Brianna Rosen.

MAY 9, 2022 Podcast

Any Progress in Building Moral Machines? with Colin Allen

Anja Kaspersen and Wendell Wallach speak with University of Pittsburgh's Professor Colin Allen to assess how we have progressed in building AI systems capable of making moral decisions.

Have you used a large language model such as ChatGPT for work?

Making Decisions When Values Conflict or Are Prioritized Differently

Emory University's Paul Root Wolpe speaks with Carnegie-Uehiro Fellow Wendell Wallach about ethical decision-making and the challenge of regulating new technologies whose impact is uncertain.

Listen to the podcast

Discussion Questions

  1. Should humans always have the ability to override a decision made by AI regardless of context?
  2. Under what kinds of conditions can more autonomy be given to AI to make decisions without human oversight, if any?
  3. Should AI systems be required to explain their decisions? Why or why not?
  4. How should responsibility be distributed between the developers, the users, or the AI itself when an AI system is involved in a decision that culminates in a bad outcome?
  5. What ethical guidelines should govern the use of AI systems for decision-making? How do those guidelines change based on context?
  6. How can we improve the fairness of AI decision-making?
  7. Should development of AI decision-making systems be regulated?

Additional Resources

How AI Can Help Leaders Make Better Decisions Under Pressure

Mark Purdy and A. Mark Williams, writing for the "Harvard Business Journal," analyze how business leaders can effectively benefit from AI decision-making technologies while mitigating the risks.

Read

How Artificial Intelligence Will Transform Decision-Making

Writing for the World Economic Forum, Philip Meissner and Yusuke Narita explore how trust, access, and integration will shape the speed of AI adoption for decision-making.

Read

Ethical Concerns Mount as AI Takes Bigger Decision-Making Role in More Industries

Writing for "The Harvard Gazette," Christina Pazzanese examines the promise and potential pitfalls of artificial intelligence and machine learning within the context of decision-making.

Read

AI Institute for Societal Decision Making

Carnegie Mellon University's institute "brings together AI and social sciences researchers to develop human-centric AI for societal good."

Learn more