A1 Journal article (refereed)
Investigating applicability of ratings of indicators of the CLASS Pre-K instrument (2023)

Pakarinen, E., Malmberg, L.-E., Poikkeus, A.-M., Siekkinen, M., & Lerkkanen, M.-K. (2023). Investigating applicability of ratings of indicators of the CLASS Pre-K instrument. International Journal of Research and Method in Education, 46(3), 231-247. https://doi.org/10.1080/1743727x.2022.2128741

JYU authors or editors

Publication details

All authors or editorsPakarinen, Eija; Malmberg, Lars-Erik; Poikkeus, Anna-Maija; Siekkinen, Martti; Lerkkanen, Marja-Kristiina

Journal or seriesInternational Journal of Research and Method in Education



Publication year2023

Publication date29/09/2022


Issue number3

Pages range231-247


Publication countryUnited Kingdom

Publication languageEnglish


Publication open accessNot open

Publication channel open accessChannel is not openly available

Publication is parallel published (JYX)https://jyx.jyu.fi/handle/123456789/84559


When classroom observations are increasingly used for accountability and evaluation purposes, a deeper understanding of the psychometric properties of such measurement tools is needed. The present study took a unique approach to examine the psychometric properties of a commonly used classroom observation measure by testing the reliability of indicators for higher-order constructs (i.e. dimensions). We investigated the reliability of indicator ratings of the Classroom Assessment Scoring System (CLASS) Pre-K instrument in Finnish kindergarten and first grade classrooms. Twenty-one observer pairs rated 838 segments identified from the 413 lessons of 48 teachers. Variance components models were specified to investigate variance proportions of each indicator and dimension. The results showed that most observer disagreement was found for the instructional support domain. Observers disagreed relatively more depending on the teacher they observed. There is a clear need for additional understanding on how observers process information on the complex elements of classroom interaction in order to improve training programmes and the reliability and accuracy of the assessment procedure.

Keywordsevaluationindicatorsteachersteaching and instructionmeasuring methodsobservation

Free keywordsclassroom assessment scoring system pre-K; indicators; inter-rater reliability; variance components models

Contributing organizations

Related projects

Ministry reportingYes

Reporting Year2022

JUFO rating1

Last updated on 2024-03-04 at 17:26