Definition & Introduction
AI decision-making refers to processes where artificial intelligence (AI) systems provide guidance or input to help humans make choices. In some of these processes, AI plays a more supportive role where outputs are reviewed and analyzed by humans prior to arriving at any conclusion. But as AI systems evolve, their role in decision-making processes can become more significant, introducing novel ethical concerns.
AI decision-making is in use across many fields and applications including:
- Healthcare: AI assists medical professionals in diagnosing diseases by analyzing lab results and patient histories.
- Finance: AI algorithms assess creditworthiness and are used in fraud detection.
- Politics: AI agents influence formal and informal deliberative processes like citizen assemblies and the spreading of ideas in digital spaces.
- Sales: AI tools within customer data platforms can automate prospecting based on buyer intent.
- Policing: Data fusion systems, leveraging AI, enable police to develop sophisticated hypotheses about who may or may not have committed a crime.
Explore the resources below for more on the ethical challenges connected to AI decision-making.

Risking Escalation for the Sake of Efficiency: Ethical Implications of AI Decision-Making in Conflicts
Stanford University's Max Lamparth analyzes the potential for AI decision-making in strategic military contexts and shares insights from two research projects regarding the escalatory tendencies of large language models.
More Resources on AI Decision-Making
NOV 13, 2024 • Article
An Ethical Grey Zone: AI Agents in Political Deliberations
SEP 12, 2024 • Article
From Principles to Action: Charting a Path for Military AI Governance
As AI reshapes war's ethical dimensions, stakeholders must work together on greater transparency and governance efforts for this emerging technology, writes Dr. Brianna Rosen.
MAY 9, 2022 • Podcast
Any Progress in Building Moral Machines? with Colin Allen
Anja Kaspersen and Wendell Wallach speak with University of Pittsburgh's Professor Colin Allen to assess how we have progressed in building AI systems capable of making moral decisions.
Have you used a large language model such as ChatGPT for work?

Making Decisions When Values Conflict or Are Prioritized Differently
Emory University's Paul Root Wolpe speaks with Carnegie-Uehiro Fellow Wendell Wallach about ethical decision-making and the challenge of regulating new technologies whose impact is uncertain.
Discussion Questions
- Should humans always have the ability to override a decision made by AI regardless of context?
- Under what kinds of conditions can more autonomy be given to AI to make decisions without human oversight, if any?
- Should AI systems be required to explain their decisions? Why or why not?
- How should responsibility be distributed between the developers, the users, or the AI itself when an AI system is involved in a decision that culminates in a bad outcome?
- What ethical guidelines should govern the use of AI systems for decision-making? How do those guidelines change based on context?
- How can we improve the fairness of AI decision-making?
- Should development of AI decision-making systems be regulated?
For more on AI ethics and decision-making, subscribe to the Carnegie Ethics Newsletter
Additional Resources
How AI Can Help Leaders Make Better Decisions Under Pressure
Mark Purdy and A. Mark Williams, writing for the "Harvard Business Journal," analyze how business leaders can effectively benefit from AI decision-making technologies while mitigating the risks.
ReadHow Artificial Intelligence Will Transform Decision-Making
Writing for the World Economic Forum, Philip Meissner and Yusuke Narita explore how trust, access, and integration will shape the speed of AI adoption for decision-making.
ReadEthical Concerns Mount as AI Takes Bigger Decision-Making Role in More Industries
Writing for "The Harvard Gazette," Christina Pazzanese examines the promise and potential pitfalls of artificial intelligence and machine learning within the context of decision-making.
ReadAI Institute for Societal Decision Making
Carnegie Mellon University's institute "brings together AI and social sciences researchers to develop human-centric AI for societal good."
Learn more