Publications

Selected Journal Papers

Does slow and steady win the race?: Clustering patterns of students’ behaviors in an interactive online mathematics game. 

Lee, J. E., Chan, J. Y. C., Botelho, A., & Ottmar, E. (2022). Does slow and steady win the race?: Clustering patterns of students’ behaviors in an interactive online mathematics game. Educational Technology Research and Development. 70(5), 1575–1599. https://doi.org/10.1007/s11423-022-10138-4

In this study, we applied a set of learning analytics methods (k-means clustering, data visualization) to clickstream data from an interactive online algebra game to unpack how middle-school students’ (N = 227) behavioral patterns (i.e., the number of problems completed, resetting problems, reattempting problems, pause time before first actions) correlated with their understanding of mathematical equivalence. 

The k-means cluster analysis identified four groups of students based on their behavioral patterns in the game: fast progressors, intermediate progressors, slow progressors, and slow-steady progressors. The results indicated that students in these clusters, with the exception of slow progressors, showed significant increases in their understanding of mathematical equivalence. In particular, slow-steady progressors, who reattempted the same problem more often than other students, showed the largest absolute learning gains, suggesting that behavioral engagement played a significant role in learning. With data visualizations, we presented evidence of variability in students’ approaches to problem solving in the game, providing future directions for investigating how differences in student behaviors impact learning. 

The effects of instructors' use of online discussions strategies on student participation and performance in university online introductory mathematics courses

Lee, J. E., & Recker, M. (2021). The effects of instructors' use of online discussions strategies on student participation and performance in university online introductory mathematics courses. Computers & Education, 162, 104084. https://doi.org/10.1016/j.compedu.2020.104084 

This study examines how student and instructor participation in online discussions impacts students’ course performance. The context for the study is university introductory online mathematics/statistics courses, which typically have much higher failure rates than their face-to-face counterparts. 

Using text-mining techniques, we analyze online discussion data automatically collected by a Learning Management System across five years from 2869 students in 72 online courses, who collectively contributed 20,884 posts. These semi-automated techniques enable a broader and more scalable view of participation behaviors by investigating: (1) student posting and non-posting behaviors (called online speaking and listening, respectively), (2) the textual content of posts, and (3) instructors’ strategies for structuring discussions.

 Multilevel modeling results show that online listening behaviors significantly predict students’ course performance. Further, students’ posts that built on other contributions or applied new knowledge have the highest predictive value in terms of course performance. Finally, the instructors’ use of open-ended prompts is the only variable positively and significantly links to students’ course performance. Links to theory, instructional practice, and educational data mining are discussed. 

Selected Presentations 

Norum, R. E., Lee, J. E., & Ottmar, E. (2023, April). Student profile based on in-game performance and help-seeking behaviors in an online mathematics game. Paper presented at the annual meeting of the American Educational Research Association (AERA), Chicago, IL.

[Awarded AERA 2023 SIG-Instructional Technology Best Student Paper]




WEB_AERA23_Jieun Lee

Lee, J. E. & Recker, M. (2020, April). Predicting student performance by modeling participation in online discussions in introductory online mathematics courses. Paper presented at the annual meeting of the American Educational Research Association (AERA), San Francisco, CA. [Cancelled due to COVID-19]

[Awarded AERA 2020 SIG-Instructional Technology Best Paper] 


WEB_AERA_2020_Jieun_Lee

Lee, J, E., & Recker, M. (2017, April). Examining students’ self-regulated learning strategies using learning management system data: An evidence-centered design approach. Paper presented at the annual meeting of the American Educational Research Association (AERA), San Antonio, TX.

[Awarded AERA 2017 SIG-Advanced Technologies for Learning/Learning Sciences Best Student Paper]


WEB_AERA17_Jieun Lee

Lee, J. E., Recker, M., Bowers, A. J., & Yuan, M. (2016). Hierarchical cluster analysis heatmaps and pattern analysis: An approach for visualizing learning management system interaction data. In T. Barnes, M. Chi & M. Feng (Eds.), Proceedings of the 9th International Conference on Educational Data Mining (pp. 603-604). New York, NY: ACM.