A4 Article in conference proceedings
Continuous experimentation on artificial intelligence software : a research agenda (2020)

Nguyen-Duc, A., & Abrahamsson, P. (2020). Continuous experimentation on artificial intelligence software : a research agenda. In P. Devanbu, M. Cohen, & T. Zimmermann (Eds.), ESEC/FSE 2020: Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (pp. 1513-1516). ACM. https://doi.org/10.1145/3368089.3417039

JYU authors or editors

Publication details

All authors or editors: Nguyen-Duc, Anh; Abrahamsson, Pekka

Parent publication: ESEC/FSE 2020: Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering

Parent publication editors: Devanbu, Prem; Cohen, Myra; Zimmermann, Thomas

Place and date of conference: Virtual Event USA, November, 2020

ISBN: 978-1-4503-7043-1

Publication year: 2020

Pages range: 1513-1516

Number of pages in the book: 1707

Publisher: ACM

Place of Publication: New York

Publication country: United States

Publication language: English

DOI: https://doi.org/10.1145/3368089.3417039

Publication open access: Not open

Publication channel open access: 

Publication is parallel published (JYX): https://jyx.jyu.fi/handle/123456789/73961

Abstract

Moving from experiments to industrial level AI software development requires a shift from understanding AI/ ML model attributes as a standalone experiment to know-how integrating and operating AI models in a large-scale software system. It is a growing demand for adopting state-of-the-art software engineering paradigms into AI development, so that the development efforts can be aligned with business strategies in a lean and fast-paced manner. We describe AI development as an “unknown unknown” problem where both business needs and AI models evolve over time. We describe a holistic view of an iterative, continuous approach to develop industrial AI software basing on business goals, requirements and Minimum Viable Products. From this, five areas of challenges are presented with the focus on experimentation. In the end, we propose a research agenda with seven questions for future studies.

Keywords: software development; software engineering; artificial intelligence; research activity

Free keywords: artificial intelligence; software

Contributing organizations

Ministry reporting: Yes

Reporting Year: 2020

JUFO rating: 1