A1 Journal article (refereed)
Investigating applicability of ratings of indicators of the CLASS Pre-K instrument (2023)


Pakarinen, E., Malmberg, L.-E., Poikkeus, A.-M., Siekkinen, M., & Lerkkanen, M.-K. (2023). Investigating applicability of ratings of indicators of the CLASS Pre-K instrument. International Journal of Research and Method in Education, 46(3), 231-247. https://doi.org/10.1080/1743727x.2022.2128741


JYU authors or editors


Publication details

All authors or editorsPakarinen, Eija; Malmberg, Lars-Erik; Poikkeus, Anna-Maija; Siekkinen, Martti; Lerkkanen, Marja-Kristiina

Journal or seriesInternational Journal of Research and Method in Education

ISSN1743-727X

eISSN1743-7288

Publication year2023

Publication date29/09/2022

Volume46

Issue number3

Pages range231-247

PublisherRoutledge

Publication countryUnited Kingdom

Publication languageEnglish

DOIhttps://doi.org/10.1080/1743727x.2022.2128741

Publication open accessNot open

Publication channel open accessChannel is not openly available

Publication is parallel published (JYX)https://jyx.jyu.fi/handle/123456789/84559


Abstract

When classroom observations are increasingly used for accountability and evaluation purposes, a deeper understanding of the psychometric properties of such measurement tools is needed. The present study took a unique approach to examine the psychometric properties of a commonly used classroom observation measure by testing the reliability of indicators for higher-order constructs (i.e. dimensions). We investigated the reliability of indicator ratings of the Classroom Assessment Scoring System (CLASS) Pre-K instrument in Finnish kindergarten and first grade classrooms. Twenty-one observer pairs rated 838 segments identified from the 413 lessons of 48 teachers. Variance components models were specified to investigate variance proportions of each indicator and dimension. The results showed that most observer disagreement was found for the instructional support domain. Observers disagreed relatively more depending on the teacher they observed. There is a clear need for additional understanding on how observers process information on the complex elements of classroom interaction in order to improve training programmes and the reliability and accuracy of the assessment procedure.


Keywordsevaluationindicatorsteachersteaching and instructionmeasuring methodsobservation

Free keywordsclassroom assessment scoring system pre-K; indicators; inter-rater reliability; variance components models


Contributing organizations


Related projects


Ministry reportingYes

Reporting Year2022

JUFO rating1


Last updated on 2024-03-04 at 17:26