Development and Validation of an Assessment Tool for Senior High School Physical Chemistry
Main Article Content
Abstract
Senior high school STEM chemistry encompasses topics in thermochemistry, chemical kinetics, chemical thermodynamics, and electrochemistry that fall under the category of physical chemistry. Developing standardized evaluation tools for physical chemistry topics in high school is crucial for ensuring fair anconsistent assessment, identifying learning gaps, and promoting effective teaching and learning practices. As an essential priority, this research study has developed an evaluation instrument that includes 30-item multiple-choice questions that underwent phases of development, evaluation, and validation. Evaluation of the test instrument was aligned with the Programme for International Student Assessment (PISA) framework which include domain of knowledge, level of cognitive demand, and scientific literacy competency. Furthermore, the study aimed to assess particular proficiency of physical chemistry that pose challenges for students. The outcomes of the assessment revealed subpar overall performance. The skewed distribution of scores, with a majority scoring below 50%, indicates significant challenges in comprehending physical chemistry concepts. This disparity underscores the significance of identifying contributors to lower scores and implementing targeted interventions to bridge knowledge gaps. As this underscored the need for thorough scrutiny and enhancement of the test instrument's content to uphold its reliability and validity, all required revisions were included in the final stage of material development since precise analysis and enhancement of these items are pivotal to accurately gauge student comprehension.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
Adesoji, F. A., Omilani, N. A., & Dada, S. O. (2017). A comparison of perceived and actual students’ learning difficulties in physical chemistry. International Journal of Brain and Cognitive Sciences, 6(1), 1-8. https://doi.org/10.5923/j.ijbcs.20170601.01
Armstrong, P. (2010). Bloom’s taxonomy. Vanderbilt University Center for Teaching.
Chen, Z. (2023). Strategies for Cultivating Innovative Thinking in High School Chemistry. International Journal of New Developments in Education. https://doi.org/10.25236/ijnde.2023.051811.
Davies, R. S., Nyland, R., Chapman, J., & Allen, G. N. (2015). Using transaction-level data to diagnose knowledge gaps and misconceptions. In Proceedings of the Fifth International Conference on Learning Analytics and Knowledge (pp. 396-397). https://doi.org/10.1145/2723576.2723620
Eric, A., Daniel, N., Richard, A., & Frederick, A. (2021). Diagnostic assessment of students' misconceptions about heat and temperature through the use of two-tier test instrument. British Journal of Education, Learning and Development Psychology, 4(1), Article O22B5EP. https://doi.org/10.52589/BJELDP-O22B5EPK
Fisher, M. R., Jr., & Bandy, J. (2019). Assessing student learning. Vanderbilt University Center for Teaching. https://cft.vanderbilt.edu/assessing-student-learning/
Hartono, H., & Siahaan, M. S. (2023). The validity of problems similar to PISA local context of North Sumatra refers to the components of the PISA scientific literacy framework. Journal of Curriculum Indonesia, 6(1), Article 78. https://doi.org/10.46680/jci.v6i1.78
Jiajuan, H. (2023). A Factor Analysis Approach to Item Level Change Score Reliability. https://doi:10.1007/978-3-031-10370-4_7
Lapitan, L. D. S., Jr., Tiangco, C. E., Sumalinog, D. A. G., Sabarillo, N. S., & Diaz, J. M. (2021). An effective blended online teaching and learning strategy during the COVID-19 pandemic. Education for Chemical Engineers, 35, 116–131. https://doi.org/10.1016/j.ece.2021.01.012
Lei, M. I., Mohammed, B. M., & Hussain, S. V. A.-H., Lokman, M. T., & Naail, M. K. (2015). Validity of teacher-made assessment: A table of specification approach. Asian Social Science, 11(5), 193. https://doi.org/10.5539/ass.v11n5p193
Lou, Y., Blanchard, P., & Kennedy, E. (2015). Development and validation of a science inquiry skills assessment. Journal of Geoscience Education, 63(3), 233-242. https://doi.org/10.5408/14-028.1
Lowmaster, S. E. (2023). Clinical applications: Validity considerations in the test selection process. Journal of Personality Assessment. Advance online publication. https://doi.org/10.1080/00223891.2023.2191279
Lucariello, J., & Naff, D. (2010). How do I get my students over their alternative conceptions (misconceptions) for learning? American Psychological Association.
Makieiev, S. (2023). The formation of natural science competency concept based on PISA international research. Вісник Луганського національного університету імені Тараса Шевченка, 1(355), 9-19. https://doi.org/10.12958/2227-2844-2023-1(355)-9-19
Mi, S., Ye, J., Yan, L., & Bi, H. (2023). Development and validation of a conceptual survey instrument to evaluate senior high school students’ understanding of electrostatics. Physical Review Physics Education Research, 19(1), Article 010114. https://doi.org/10.1103/physrevphyseducres.19.010114
Michael, D. F. (2017). Table of specifications. In Encyclopedia of personality and individual differences. Springer. https://doi.org/10.1007/978-3-319-56782-2_1255-2
Munkh-Erdene, Y., Enkhlut, C., Bulgamaa, B., & Burmaa, B. (2022). Measuring the knowledge about science in students’ learning achievement. Mongolian Journal of Physics, 31(536), Article 341. https://doi.org/10.22353/physics.v31i536.341
Ogden, M. A. (2017). An inquiry experience with high school students to develop an understanding of intermolecular forces by relating boiling point trends and molecular structure. Journal of Chemical Education, 94(9), 1252-1255. https://doi.org/10.1021/acs.jchemed.6b00697
Omiko, A. (2017). Identification of the areas of students' difficulties in chemistry curriculum at the secondary school level. International Journal of Emerging Trends in Science and Technology, 4(4), Article 04. https://doi.org/10.18535/ijetst/v4i4.04
Papadakis, S., Kiv, A. E., Kravtsov, H. M., Osadchyi, V. V., Marienko, M. V., Pinchuk, O. P., ... & Striuk, A. M. (2023). Unlocking the power of synergy: The joint force of cloud technologies and augmented reality in education. In Proceedings of the 10th Workshop on Cloud Technologies in Education (CTE 2021) and the 5th International Workshop on Augmented Reality in Education (AREdu 2022) (pp. 1-10). Kryvyi Rih, Ukraine.
Rosidin, U., Herliani, D., & Viyanti. (2023). Development of assessment instruments in project-based learning to measure students' scientific literacy and creative thinking skills on work and energy materials. Jurnal Penelitian Pendidikan IPA (JPPIPA, 9(6), Article 2421. https://doi.org/10.29303/jppipa.v9i6.2421
Salame, I. I., & Khalil, A. Y. (2023). Examining some of the challenges students face in learning about rearrangement reactions in organic chemistry. Interdisciplinary Journal of Environmental and Science Education, 19(3), Article e2310. https://doi.org/10.29333/ijese/13203
Samarapungavan, A., Mantzicopoulos, P., Patrick, H., & French, B. F. (2009). The development and validation of the Science Learning Assessment (SLA): A measure of kindergarten science learning. Journal of Advanced Academics, 20(3), 502-535. https://doi.org/10.1177/1932202X0902000306
Sijtsma, K., van der Ark, A., Tijmstra, L., & Zijlmans, E. O. (2019). Item-score reliability as a selection tool in test construction. Frontiers in Psychology, 9, Article 2298. https://doi.org/10.3389/fpsyg.2018.02298
Smith, W., & Holloway, J. (2020). School testing culture and teacher satisfaction. Educational Assessment, Evaluation and Accountability, 32, 461 - 479. https://doi.org/10.1007/s11092-020-09342-8.
Wiliam, D. (2011). What Is Assessment for Learning. Studies in Educational Evaluation, 37, 3-14. https://doi.org/10.1016/J.STUEDUC.2011.03.001.tralian Skills Quality Authority. (2015). Users' guide to the Standards for Registered Training Organisations (RTOs) 2015. Commonwealth of Australia.
Yuhana, Y., & Dewi, R. (2023). Development of "HOTS" assessment instruments in enhancing students' understanding of elementary school science subjects. Jurnal Penelitian Pendidikan IPA (JPPIPA, 9(6), Article 3723. https://doi.org/10.29303/jppipa.v9i6.3723
Yusrizal, Suliyanah, & Basri, T. H. (2017). Analysis of knowledge, understanding, and skills of physics teachers of state senior high schools in developing and analyzing test items. Jurnal Pendidikan IPA Indonesia, 6(2), 335-340. https://doi.org/10.15294/jpii.v6i2.10523
Zourmpakis, A. I., Kalogiannakis, M., & Papadakis, S. (2023). Adaptive gamification in science education: An analysis of the impact of implementation and adapted game elements on students’ motivation. Computers, 12(7), 143. https://doi.org/10.3390/computers12070143