A1 Journal article (refereed)
Deep Networks for Collaboration Analytics : Promoting Automatic Analysis of Face-to-Face Interaction in the Context of Inquiry-Based Learning (2021)
Lämsä, J., Uribe, P., Jiménez, A., Caballero, D., Hämäläinen, R., & Araya, R. (2021). Deep Networks for Collaboration Analytics : Promoting Automatic Analysis of Face-to-Face Interaction in the Context of Inquiry-Based Learning. Journal of Learning Analytics, 8(1), 113-125. https://doi.org/10.18608/jla.2021.7118
JYU authors or editors
Publication details
All authors or editors: Lämsä, Joni; Uribe, Pablo; Jiménez, Abelino; Caballero, Daniela; Hämäläinen, Raija; Araya, Roberto
Journal or series: Journal of Learning Analytics
eISSN: 1929-7750
Publication year: 2021
Publication date: 09/04/2021
Volume: 8
Issue number: 1
Pages range: 113-125
Publisher: Society for Learning Analytics Research
Publication country: Canada
Publication language: English
DOI: https://doi.org/10.18608/jla.2021.7118
Publication open access: Openly available
Publication channel open access: Open Access channel
Publication is parallel published (JYX): https://jyx.jyu.fi/handle/123456789/75023
Abstract
Scholars have applied automatic content analysis to study computer-mediated communication in computer-supported collaborative learning (CSCL). Since CSCL also takes place in face-to-face interactions, we studied the automatic coding accuracy of manually transcribed face-to-face communication. We conducted our study in an authentic higher-education physics context where computer-supported collaborative inquiry-based learning (CSCIL) is a popular pedagogical approach. Since learners’ needs for support in CSCIL vary in the different inquiry phases (orientation, conceptualization, investigation, conclusion, and discussion), we studied, first, how the coding accuracy of five computational models (based on word embeddings and deep neural networks with attention layers) differed in the various inquiry-based learning (IBL) phases when compared to human coding. Second, we investigated how the different features of the best performing computational model improved the coding accuracy. The study indicated that the accuracy of the best performing computational model (differentiated attention with pre-trained static embeddings) was slightly better than that of the human coder (58.9% vs. 54.3%). We also found that considering the previous and following utterances, as well as the relative position of the utterance, improved the model’s accuracy. Our method illustrates how computational models can be trained for specific purposes (e.g., to code IBL phases) with small data sets by using pre-trained models.
Keywords: collaborative learning; computer-assisted learning; interaction; content analysis
Free keywords: collaboration analytics; computational models; computer-supported collaborative learning; CSCL; CSCIL; deep networks; inquiry-based learning; word embedding
Contributing organizations
Related projects
- Competitive funding to strengthen universities’ research profiles. Profiling actions at the JYU, round 1
- Hämäläinen, Keijo
- Academy of Finland
Ministry reporting: Yes
Preliminary JUFO rating: 1