A1 Journal article (refereed)
A replication study on the intuitiveness of programming language syntax (2023)

Lappi, V., Tirronen, V., & Itkonen, J. (2023). A replication study on the intuitiveness of programming language syntax. Software Quality Journal, 31(4), 1211-1240. https://doi.org/10.1007/s11219-023-09631-7

JYU authors or editors

Publication details

All authors or editors: Lappi, Vilma; Tirronen, Ville; Itkonen, Jonne

Journal or series: Software Quality Journal

ISSN: 0963-9314

eISSN: 1573-1367

Publication year: 2023

Publication date: 25/05/2023

Volume: 31

Issue number: 4

Pages range: 1211-1240

Publisher: Springer Science and Business Media LLC

Publication country: United States

Publication language: English

DOI: https://doi.org/10.1007/s11219-023-09631-7

Publication open access: Openly available

Publication channel open access: Partially open access channel

Publication is parallel published (JYX): https://jyx.jyu.fi/handle/123456789/87476

Abstract

In this article, we present a replication of an empirical experiment that evaluates intuitiveness and comprehensibility of keywords relating to different concepts in programming languages, originally conducted by Stefik and Gellenbeck. Novice programmers face many barriers when learning programming. One of these barriers is syntax, which for many languages is not designed based on empirical evidence. The purpose of the experiment was to provide more empirical evidence on the subject, to find out if the results of the original experiment can be replicated and if conducting the experiment in an environment where English is not the native language affects the results. The results of our experiment replicated most of the findings of the original study and provided further evidence that some syntactic choices in many popular programming languages are unintuitive for novice programmers. Our results suggest that the native language of participants who otherwise had good English skills had little effect when compared to the original study. These results may support programming language designers in making evidence-based design decisions and teachers of introductory programming courses in identifying some of the barriers novice programmers face.

Keywords: computer programmers; programming; programming languages; learning; higher education (teaching); mother tongue

Free keywords: program comprehension; syntax; programming languages; novice programmers; native language in programming

Contributing organizations

Ministry reporting: Yes

Reporting Year: 2023

Preliminary JUFO rating: 2