Rater uncertainty and its impact on the quality of assessment in the official language examination, the National Certificates of Language Proficiency (YKI): research dataset

Honko, Mari; Neittaanmäki, Reeta; Huhta, Ari; Jarvis, Scott. (2023). Rater uncertainty and its impact on the quality of assessment in the official language examination, the National Certificates of Language Proficiency (YKI): research dataset. V. 30.6.2022. University of Jyväskylä. https://doi.org/10.17011/jyx/dataset/88217.

All authors: Honko, Mari; Neittaanmäki, Reeta; Huhta, Ari; Jarvis, Scott

Funders: Centre for Applied Language Studies

Right-holders: 

Availability and identifiers

Availability: Contact owner

Publication year: 2023

URN identifier in original repository: http://urn.fi/URN:NBN:fi:jyu-202307044357

DOI identifier in original repository: https://doi.org/10.17011/jyx/dataset/88217

URN identifier in JYX: http://urn.fi/URN:NBN:fi:jyu-202307044357

DOI identifier in JYX: https://doi.org/10.17011/jyx/dataset/88217

Description of the dataset

Description: The study examines the uncertainty experienced by language raters and the impact of uncertainty on the quality of assessment in the National Certificates of Language Proficiency (YKI), an official language test for adults in Finland. A total of 27 speaking and 23 writing raters participated in the study. The raters had completed the training required and were licensed by the Finnish National Agency for Education to act as raters. During the study, the raters reflected on their lived experiences of uncertainty in general and concerning one particular examination round. The data consists of responses to three online surveys (initial survey, session surveys, final survey) and notes taken during the assessment. In addition, the proficiency ratings and information on rater experience are included in the data. Both qualitative and quantitative methods were used to analyse the data.

Language: Finnish

Free keywords: rater behavior; uncertainty; confidence; rating quality; language assessment; test assessment; assessing writing; assessing speaking; National Certificates of Language Proficiency; Finnish language

Keywords (YSO): evaluation; evaluation research; adult language proficiency test; oral language skills; ability to write; uncertainty

Fields of science: 6121 Languages; 616 Other humanities

Follow-up groups: Applied language studies (Centre for Applied Language Studies SOLKI); Multiliteracies for social participation and in learning across the life span (University of Jyväskylä JYU) MultiLEAP; 2021-2026. Formerly RECLAS; School of Wellbeing (University of Jyväskylä JYU) JYU.Well; Accounting (School of Business and Economics JSBE) YLA; National Certificates of Language Proficiency (Centre for Applied Language Studies SOLKI) YKI

Do you deal with data concerning special categories of personal data in your research?: No