Explainable Artificial Intelligence for Reliable and Transparent Decision Support Systems

Authors

  • Tianling Yun Department of Computer Science and Engineering, University of Nevada, Reno, Reno, NV, USA. Author
  • Bichard Bansen Department of Computer Science, Binghamton University, Binghamton, NY, USA. Author
  • Francesco Meran Department of Computer Science and Engineering, University at Buffalo, Buffalo, NY, USA. Author

Keywords:

explainable artificial intelligence; decision support systems; reliability; transparency; governance; socio-technical infrastructure; fairness; accountability; deployment; lifecycle management

Abstract

The growing deployment of data-driven decision support systems across critical domains has intensified demands for transparency, accountability, and operational reliability. Explainable artificial intelligence has emerged as a socio-technical response to these demands, yet its integration into dependable decision support infrastructures remains uneven and conceptually fragmented. This paper examines explainable artificial intelligence from a systems perspective, focusing on structural trade-offs, architectural layering, governance mechanisms, deployment constraints, and lifecycle sustainability rather than on isolated algorithmic techniques. The discussion develops an integrated view in which explanation is treated not as a post hoc addition to an opaque model, but as a property distributed across data pipelines, model selection processes, interface design, organizational workflows, and regulatory environments. The paper analyzes how different explanation modalities interact with institutional decision practices, how reliability and robustness requirements shape explanation infrastructures, and how fairness and accountability obligations complicate the design of transparent systems. Cross-domain comparisons from clinical, financial, and public sector applications illustrate the importance of context-sensitive explanation strategies. The paper further addresses policy implications, including the rise of regulatory frameworks that demand meaningful transparency and human oversight. By connecting technical design choices to institutional and regulatory contexts, the analysis provides an interdisciplinary foundation for building decision support systems that are not only accurate but also legible, contestable, and sustainable. The result is a system-level research agenda that positions explainability as a core infrastructural capability for dependable artificial intelligence.

References

1. Miller, T. (2019). Explanation in artificial intelligence: Insights from the social sciences. Artificial Intelligence, 267, 1-38.

2. Doshi-Velez, F., & Kim, B. (2017). Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608.

3. Rudin, C. (2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5), 206-215.

4. Lipton, Z. C. (2018). The mythos of model interpretability. Communications of the ACM, 61(10), 36-43.

5. Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., & Pedreschi, D. (2018). A survey of methods for explaining black box models. ACM Computing Surveys, 51(5), Article 93.

6. Lundberg, S. M., & Lee, S.-I. (2017). A unified approach to interpreting model predictions. Advances in Neural Information Processing Systems, 30, 4765-4774.

7. Ribeiro, M. T., Singh, S., & Guestrin, C. (2016). Why should I trust you? Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 1135-1144). ACM.

8. Wachter, S., Mittelstadt, B., & Russell, C. (2018). Counterfactual explanations without opening the black box: Automated decisions and the GDPR. Harvard Journal of Law & Technology, 31(2), 841-887.

9. Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., & Mané, D. (2016). Concrete problems in AI safety. arXiv preprint arXiv:1606.06565.

10. Hendrycks, D., & Dietterich, T. G. (2019). Benchmarking neural network robustness to common corruptions and perturbations. arXiv preprint arXiv:1903.12261.

11. Barocas, S., Hardt, M., & Narayanan, A. (2019). Fairness and machine learning: Limitations and opportunities. MIT Press.

12. Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019). Model cards for model reporting. In Proceedings of the Conference on Fairness, Accountability, and Transparency (pp. 220-229). ACM.

13. Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé III, H., & Crawford, K. (2021). Datasheets for datasets. Communications of the ACM, 64(12), 86-92.

14. Selbst, A. D., Boyd, D., Friedler, S. A., Venkatasubramanian, S., & Vertesi, J. (2019). Fairness and abstraction in sociotechnical systems. In Proceedings of the Conference on Fairness, Accountability, and Transparency (pp. 59-68). ACM.

15. Preece, A., Harborne, D., Braines, D., Tomsett, R., & Chakraborty, S. (2018). Stakeholders in explainable AI. arXiv preprint arXiv:1810.00184.

16. Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., Chatila, R., & Herrera, F. (2020). Explainable artificial intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion, 58, 82-115.

17. European Commission. (2021). Proposal for a regulation laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). COM/2021/206 final.

18. Goodman, B., & Flaxman, S. (2017). European Union regulations on algorithmic decision-making and a right to explanation. AI Magazine, 38(3), 50-57.

19. Kaur, H., Nori, H., Jenkins, S., Caruana, R., Wallach, H., & Wortman Vaughan, J. (2020). Interpreting interpretability: Understanding data scientists' and lay users' interpretations of interpretability. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (pp. 1-14). ACM.

20. Saria, S., & Subbaswamy, A. (2019). Tutorial: Safe and reliable machine learning. arXiv preprint arXiv:1904.07204.

21. Bhatt, U., Xiang, A., Sharma, S., Weller, A., Taly, A., Jia, Y., Ghosh, J., Puri, R., Moura, J. M. F., & Eckersley, P. (2020). Explainable machine learning in deployment. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (pp. 648-657). ACM.

22. Dignum, V. (2019). Responsible artificial intelligence: How to develop and use AI in a responsible way. Springer.

Downloads

Published

2026-07-03