References & Citations
Computer Science > Artificial Intelligence
Title: Towards the New XAI: A Hypothesis-Driven Approach to Decision Support Using Evidence
(Submitted on 2 Feb 2024 (v1), last revised 28 Apr 2024 (this version, v2))
Abstract: Prior research on AI-assisted human decision-making has explored several different explainable AI (XAI) approaches. A recent paper has proposed a paradigm shift calling for hypothesis-driven XAI through a conceptual framework called evaluative AI that gives people evidence that supports or refutes hypotheses without necessarily giving a decision-aid recommendation. In this paper, we describe and evaluate an approach for hypothesis-driven XAI based on the Weight of Evidence (WoE) framework, which generates both positive and negative evidence for a given hypothesis. Through human behavioural experiments, we show that our hypothesis-driven approach increases decision accuracy and reduces reliance compared to a recommendation-driven approach and an AI-explanation-only baseline, but with a small increase in under-reliance compared to the recommendation-driven approach. Further, we show that participants used our hypothesis-driven approach in a materially different way to the two baselines.
Submission history
From: Thao Le [view email][v1] Fri, 2 Feb 2024 10:28:24 GMT (2614kb,D)
[v2] Sun, 28 Apr 2024 03:29:54 GMT (5363kb,D)
Link back to: arXiv, form interface, contact.