A Study on Functional Requirements and Inspection Items for AI System Change Management and Model Improvement on the Web Platform
DOI:
https://doi.org/10.13052/jwe1540-9589.2366Keywords:
AI ethics, AI model improvement, AI retraining, AI feedback loop, functional requirements and inspection items for AIAbstract
The rapid adoption of artificial intelligence (AI) on the web platform across multiple sectors has highlighted not only its inherent technical hurdles, such as unpredictability and lack of transparency, but also significant societal concerns. These include the misuse of AI technology, invasions of privacy, discrimination fueled by biased data, and infringements of copyright. Such challenges jeopardize the sustainable growth of AI and risk the erosion of societal trust, industry adoption and financial investment.
This analysis explores the AI system’s lifecycle, emphasizing the essential continuous monitoring and the need for creating trustworthy AI technologies. It advocates for an ethically oriented development process to mitigate adverse effects and support sustainable progress. The dynamic and unpredictable nature of AI, compounded by variable data inputs and evolving distributions, requires consistent model updates and retraining to preserve the integrity of services.
Addressing the ethical aspects, this paper outlines specific guidelines and evaluation criteria for AI development, proposing an adaptable feedback loop for model improvement. This method aims to detect and rectify performance declines through prompt retraining, thereby cultivating robust, ethically sound AI systems. Such systems are expected to maintain performance while ensuring user trust and adhering to data science and web technology standards. Ultimately, the study seeks to balance AI’s technological advancements with societal ethics and values, ensuring its role as a positive, reliable force across different industries. This balance is crucial for harmonizing innovation with the ethical use of data and science, thereby facilitating a future where AI contributes significantly and responsibly to societal well-being.
Downloads
References
AI Center of Excellence. AI Guide for Government: A Living and Evolving Guide to the Application of AI for the U.S. Federal Government, 2023.
Lu, J. Liu, A. Dong, F. Gu, F Gama, J. Zhang, G. Learning under Concept Drift: A Review. IEEE Trans Knowl Data Eng. 2019, 31, 2346–2363.
Gartner Research. Infographic: AI Use Case Prism for Retail. 2021.
O’Neil. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. 2016.
Eubanks. Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor. 2018.
West, S. M.; Whittaker, M.; Crawford, K. Discriminating Systems: Gender, Race and Power in AI. AI Now Institute. 2019. Available Online: https://ainowinstitute.org/discriminatingsystems.html. (accessed on 16 June 2023).
Raţiu S, Aurel R, Cãtãlinoiu, Zsolt Miklos I. “Self-Adaptive Mechanical Reducer With Variable Gear Ratio.” Journal of Automotive Engineering. 2021, 66.
Greco, Salvatore, et al. “On the methodological framework of composite indices: A review of the issues of weighting, aggregation, and robustness.” Social indicators research 141 (2019): 61–94.
Nagabandi, A. Finn, C. Levine, S. Deep Online Learning via Meta-Learning: Continual Adaptation for Model-Based RL. In Proceedings of the ICLR 2019, New Orleans, USA, 6–9 May 2019; Available online: https://iclr.cc/Conferences/2019/Schedule?showEvent=1078 (accessed on 23 June 2023).
Hospedales T, Antoniou A, Micaelli P, Storkey A. Meta-Learning in Neural Networks: A Survey. IEEE Trans. Pattern Anal. Mach. 2022, 44, 5149–5169.
Mai Z, Li R, Jeong J, Quispe D, Kim HW, Sanner S. Online continual learning in image classification: An empirical survey. Neurocomputing. 2022, 469, 28–51.
Arnold Z, Toner H. AI Accidents: An Emerging Threat. Center for Security and Emerging Technology. 2021. Available online: https://doi.org/10.51593/20200072 (accessed on 3 July 2023).
Lepri B, Oliver N, Pentland A. Ethical machines: The human-centric use of AI. iScience. 2021, 24, 3.
Brundage M, Avin S, Clark J, Toner H, Eckersley P, Garfinkel B, Dafoe A, Scharre P, Zeitzoff T, Filar B, Anderson H, Roff H, Allen GC, Steinhardt J, Flynn C, Héigeartaigh S Ó, Beard S, Belfield H, Farquhar S, et al. The Malicious Use of AI: Forecasting, Prevention, and Mitigation. Apollo – University of Cambridge Repository. 2018.
Ministry of Science and ICT ⋅ Korea Information and Communication Technology Association, (2022), 2022 Trustworthy AI Development Guide (draft).
Ng A. Healthcare’s AI Future: A Conversation with Fei-Fei Li & Andrew Ng. Stanford University Human-Centered AI. 2021.
John-Mathews JM, Cardon D, Balagué C. From Reality to World. A Critical Perspective on AI Fairness. J Bus Ethics. 2022, 178, 945–959.
McLennan S, Lee MM, Fiske A, Celi LA. AI Ethics Is Not a Panacea. Am J Bioeth. 2020, 20, 20–22.
Borenstein J, Howard A. Emerging challenges in AI and the need for AI ethics education. AI Ethics. 2021, 1, 61–65.
Hagendorff, T. The Ethics of AI Ethics: An Evaluation of Guidelines. Minds & Machines. 2020, 30, 99–120.
Angwin J, Larson J, Mattu S, Kirchner L. Machine Bias. In Ethics of Data and Analytics: Concepts and Cases, 1st ed.; Kirsten Martin, Ed.; Auerbach Publications: New York, USA, 2022; pp. 254–264.
Cheng Z, Zhu X, Gong S. Surveillance Face Recognition Challenge. Technical Report 2018. Available online: https://qmul-survface.github.io/ (accessed on 5 July 2023).
Dilmegani C. Bias in AI: What It Is, Types and Examples of Bias, and Tools to Fix It. Science and Technology. 2022, 52, 1–3.
Leslie D, Mazumder A, Peppin A, Wolters MK, Hagerty A. Does “AI” Stand for Augmenting Inequality in the Era of Covid-19 Healthcare? BMJ. 2021, 372.
Chang K. AI in Personnel Management: The Development of APM Model. The Bottom Line. 2020, 33, 377–388.
Mitov A. Ethical Use of AI Through the Utilitarianism Perspective. Bachelor’s thesis, University of Twente, Netherland. 2021.
Markham AN, Tiidenberg K, Herman A. Ethics as Methods: Doing Ethics in the Era of Big Data Research – Introduction. Social Media+Society. 2018, 4.
Park HY. New Arguments in AI Ethics and Related Essential Considerations. The Jour. Yeolin Edu. 2022, 30, 173–201.
Feldstein S. The Global Expansion of AI Surveillance. Carnegie Endowment for International Peace, 2019. Available online: https://carnegieendowment.org/2019/09/17/global-expansion-of-ai-surveillance-pub-79847 (accessed on 23 July 2023).
Leslie, D. Understanding AI ethics and safety: A guide for the responsible design and implementation of AI systems in the public sector. The Alan Turing Institute. 2019. Available online: https://doi.org/10.5281/zenodo.3240529 (accessed on 29 July 2023).
Alan Turing Institute. 2019.
ISO/IEC TR24027:2021, Information technology – AI (AI) – Bias in AI systems and AI aided decision making, 2021.
