A4 Article in conference proceedings
Can ChatGPT Challenge the Scientific Impact of Published Research, Particularly in the Context of Industry 4.0 and Smart Manufacturing? (2024)


Terziyan, V., Kaikova, O., Golovianko, M., & Vitko, O. (2024). Can ChatGPT Challenge the Scientific Impact of Published Research, Particularly in the Context of Industry 4.0 and Smart Manufacturing?. In F. Longo, W. Shen, & A. Padovano (Eds.), 5th International Conference on Industry 4.0 and Smart Manufacturing (ISM 2023) (pp. 2540-2550). Elsevier. Procedia Computer Science, 232. https://doi.org/10.1016/j.procs.2024.02.072


JYU authors or editors


Publication details

All authors or editors: Terziyan, Vagan; Kaikova, Olena; Golovianko, Mariia; Vitko, Oleksandra

Parent publication: 5th International Conference on Industry 4.0 and Smart Manufacturing (ISM 2023)

Parent publication editors: Longo, Francesco; Shen, Weiming; Padovano, Antonio

Conference:

  • International Conference on Industry 4.0 and Smart Manufacturing

Place and date of conference: Lisbon, Portugal, 22.-24.11.2023

Journal or series: Procedia Computer Science

ISSN: 1877-0509

eISSN: 1877-0509

Publication year: 2024

Publication date: 20/03/2024

Number in series: 232

Pages range: 2540-2550

Number of pages in the book: 3277

Publisher: Elsevier

Publication country: Netherlands

Publication language: English

DOI: https://doi.org/10.1016/j.procs.2024.02.072

Publication open access: Openly available

Publication channel open access: Open Access channel

Publication is parallel published (JYX): https://jyx.jyu.fi/handle/123456789/94148


Abstract

The released ChatGPT as a powerful language model is capable of assisting with a wide range of tasks, including answering questions, summarizing, paraphrasing, proofreading, classifying, and integrating texts. In this study, we tested ChatGPT capability to assist researchers in evaluating the academic articles’ contribution. We suggest a dialogue schema in which ChatGPT is asked to answer research questions from the target article and then to compare its own answers with the answers from the article. Finally, ChatGPT is asked to integrate both solutions coherently. We experimented with Proceedings of ISM-2022 Conference on Industry 4.0 and Smart Manufacturing, utilizing explicit research questions. The chat context enabled assessing studied articles’ contributions to Industry 4.0, uncovering advancements beyond the state-of-the-art. However, ChatGPT demonstrates limitations in content understanding and contribution evaluation. We conclude that while it collaborates with humans on academic tasks, human guidance remains essential, while ChatGPT's assistance efficiently complements traditional academic processes.
See presentation slides: https://ai.it.jyu.fi/ISM-2023-ChatGPT.pptx


Keywords: artificial intelligence; science publishing; manufacturing engineering

Free keywords: artificial intelligence; ChatGPT; Industry 4.0; smart manufacturing; academic impact


Contributing organizations


Ministry reporting: Yes

VIRTA submission year: 2024

Preliminary JUFO rating: 1


Last updated on 2024-02-07 at 23:26