Oral Presentation Royal Australian Chemical Institute National Congress 2026

Evaluating Observation Methods: A Comparative Study of Protocols and Recordings in Laboratory-Based Learning (136853)

Yuqing Fang 1 , Shane Wilkinson 1 , Reyne Pullen 1 , Stephen George-Williams 1
  1. The University of Sydney, Sydney, NSW, Australia

Laboratory classes are complex learning environments in which student engagement is dynamic and often difficult to assess using conventional self-report measures (Hofstein & Lunetta, 2004). Questionnaires are commonly used to capture students’ perceptions, and various observation methods such as structured observation protocols, video recordings, and audio recordings have also been applied in competency-based assessments and educational research (Velasco et al., 2016; Wei et al., 2018). However, insufficient attention has been directed toward the systematic evaluation and comparison of these observation methods for capturing student behaviour in laboratory settings, particularly through the application of a rubric to assess which method or combination of methods is most appropriate for addressing varying research or instructional objectives.

 

Using a pilot study focusing on titration and the chemistry of sticky things experiments conducted by volunteer undergraduate chemistry students at the University of Sydney, this research addresses three key questions: (1) the accuracy of the revised observation protocol; (2) differences between observation techniques; and (3) the effectiveness of the method in controlled versus authentic laboratory environments. In addition, the revised observation protocol has been applied to real-laboratory settings across science disciplines, including chemistry and biology, to further refine it for wider applicability. The findings will offer valuable insights into observation methods using this protocol, contributing to both methodological advances in educational research and practical improvements in science education assessment.

  1. Hofstein, A., & Lunetta, V. N. (2004). The laboratory in science education: Foundations for the twenty-first century. Science Education, 88(1), 28-54. https://doi.org/https://doi.org/10.1002/sce.10106 Velasco, J. B., Knedeisen, A., Xue, D., Vickrey, T. L., Abebe, M., & Stains, M. (2016). Characterizing instructional practices in the laboratory: The laboratory observation protocol for undergraduate STEM. Journal of Chemical Education, 93(7), 1191-1203. Wei, J., Mocerino, M., Treagust, D. F., Lucey, A. D., Zadnik, M. G., Lindsay, E. D., & Carter, D. J. (2018). Developing an understanding of undergraduate student interactions in chemistry laboratories. Chemistry Education Research and Practice, 19(4), 1186-1198. https://doi.org/10.1039/c8rp00104a