Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Exploring the Effect of Explanation Content and Format on User Comprehension and Trust in Healthcare

Created by
  • Haebom

Author

Antonio Rago, Bence Palfi, Purin Sukpanichnant, Hannibal Nabli, Kavyesh Vivek, Olga Kostopoulou, James Kinross, Francesca Toni

Outline

This paper explores the explainability of AI tools in the medical field, using QCancer, a cancer risk prediction tool, as an example. Experiments were conducted with laypeople (patients) and medical students (healthcare workers) using two explanation methods: SHAP and Occlusion-1, in chart (SC, OC) and text (OT) formats. The results showed that Occlusion-1 had higher subjective comprehension and trustworthiness than SHAP, but this was likely due to a preference for the text format (OT). In other words, the format of the explanation had a greater impact on user understanding and trust than the content itself.

Takeaways, Limitations

Takeaways:
To enhance the explainability of medical AI tools, we emphasize that not only the content of explanations but also the form is important.
In particular, it suggests that brief descriptions may be effective when provided in text format.
It demonstrates the importance of choosing a description format that takes into account the characteristics of the user group (patients, healthcare workers).
Limitations:
Because the experimental subjects were limited to the general public and medical students, they may not reflect the diverse stakeholders in actual medical settings.
Relying on subjective measures of understanding and reliability may result in a lack of objective assessment.
Because these results are from a study of a specific tool called QCancer, they may not be generalizable to other medical AI tools.
More research is needed on a wider range of formats, beyond simply comparing text and chart formats.
👍