2021-01-11 | Le Wang: Expert Judgments in Overriding Artificial Intelligence
AI is increasingly intertwined with the work of experts. The ubiquitous use of AI algorithms to provide prescription alerts are often faced with experts’ resistance and this can manifest in the form of experts overriding these prescription alerts. Overriding AI prescriptions limits the potential of AI for the organization. In this field study, we tracked the actions of 1,039 different physicians when they encountered AI alerts in a hospital over a period of 22 months. We collected a total of 43,328 instances of AI alerts and examined the physicians’ overriding behavior towards these alerts. This paper posits that the physicians’ overriding of the alerts are associated with the context and expert’s characteristics. We argue that how physicians – as experts – construe the AI alerts influences the eventual overriding behavior. We contend for the need to understand better the boundary conditions that are associated with excessive AI alert overriding to ensure a better integration of AI with expert work.
Le Wang is a Ph.D. Candidate in Information Systems at Nanyang Business School, Nanyang Technological University, Singapore. His primary research interests are health informatics, application of AI in business, and user behavior in digital platforms. Le holds a Bachelor's degree in Logistics Management from Ocean University of China and a Master's degree in Management Science and Engineering from Harbin Institute of Technology.