IJIET 2026 Vol.16(2): 422-435
doi: 10.18178/ijiet.2026.16.2.2515
doi: 10.18178/ijiet.2026.16.2.2515
PhET Simulations Performance to Measure Complex Problem-Solving Skills in Physics Subject Matter: Evidence of Validity and Reliability
Eko Juliyanto1,2, Wiyanto Wiyanto3,*, Sunyoto E. Nugroho4, and Budi N. Mindyarto4
1. Science Education Doctoral Program, Faculty of Mathematics and Natural Sciences,
Universitas Negeri Semarang, Semarang, Indonesia
2. Department of Science Education, Faculty of Teacher Training and Education, Universitas Tidar, Magelang, Indonesia
3. Science Education Doctoral Program, Faculty of Mathematics and Natural Sciences, Universitas Negeri Semarang, Semarang, Indonesia
4. Departement of Physics, Faculty of Mathematics and Natural Sciences, Universitas Negeri Semarang, Semarang, Indonesia
Email: ekojuliyanto@untidar.ac.id (E.J.); wiyanto@mail.unnes.ac.id (W.W.); ekonuphysed@mail.unnes.ac.id (S.E.N.); budinaini@mail.unnes.ac.id (B.N.M.)
*Corresponding author
2. Department of Science Education, Faculty of Teacher Training and Education, Universitas Tidar, Magelang, Indonesia
3. Science Education Doctoral Program, Faculty of Mathematics and Natural Sciences, Universitas Negeri Semarang, Semarang, Indonesia
4. Departement of Physics, Faculty of Mathematics and Natural Sciences, Universitas Negeri Semarang, Semarang, Indonesia
Email: ekojuliyanto@untidar.ac.id (E.J.); wiyanto@mail.unnes.ac.id (W.W.); ekonuphysed@mail.unnes.ac.id (S.E.N.); budinaini@mail.unnes.ac.id (B.N.M.)
*Corresponding author
Manuscript received July 15, 2025; revised August 6, 2025; accepted September 17, 2025; published February 9, 2026
Abstract—This study aims to analyze the performance of the Physics-Complex Problem-Solving (Ph-CPS) skills test using Physics Education Technology (PhET) simulations to measure Complex Problem-Solving (CPS) skills using physics subject matter as the problem context. This study is instrumentation research that produces a CPS skill measurement instrument that will be used in physics classes. The results indicated that the Ph-CPS test meets the criteria for complex problems and minimal complex system criteria. Construct validity and reliability analysis using the Rasch model showed that only Ph- CPS 1, Ph-CPS 2, and Ph-CPS 4 items were valid and reliable. The results of the concurrent validity analysis indicated that Ph- CPS items 1, 2, and 4 align with the PISA 2012 CPS test. Ph-CPS item 3 is considered too easy because it has similarities with Angry Birds games, so it is classified as a “familiar problem”. The results of the concurrent validity analysis show that Ph-CPS items 1, Ph-CPS 2, and Ph-CPS 4 have concurrent validity against the 2012 PISA test. Regression analysis between physics concept mastery and Ph-CPS skills showed no significant influence of physics concepts on Ph-CPS skills. It indicates that the Ph-CPS test measures domain-general skills.
Keywords—complex problem-solving, physics education, PhET simulations, domain-general skill, instrumentation research
Copyright © 2026 by the authors. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).
Keywords—complex problem-solving, physics education, PhET simulations, domain-general skill, instrumentation research
Cite: Eko Juliyanto, Wiyanto Wiyanto, Sunyoto E. Nugroho, and Budi N. Mindyarto, "PhET Simulations Performance to Measure Complex Problem-Solving Skills in Physics Subject Matter: Evidence of Validity and Reliability," International Journal of Information and Education Technology, vol. 16, no. 2, pp. 422-435, 2026.
Copyright © 2026 by the authors. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).