Developing and Validating a 4D Reflection Rubric for Assessing Teacher Professional Reflection in Narrative Writing
DOI:
https://doi.org/10.70211/wesw.v3i1.440Keywords:
Pedagogical Reflection, Narrative Assessment, Rubric Development, Teacher Professional Development, Content ValidityAbstract
Assessing teacher reflection in narrative texts remains challenging because existing rubrics often privilege explicit analytical writing and may overlook reflective meanings embedded in stories. This study aimed to develop and validate a multidimensional, genre-sensitive 4D Reflection Rubric for assessing pedagogical reflection in teacher-authored short stories. Using a Research and Development design adapted from the 4D model, the study involved 30 in-service elementary school teachers who produced classroom-based narratives, five expert validators, and five independent raters. The rubric was developed across four dimensions: cognitive, affective-relational, ethical, and action-oriented reflection. Data were analyzed using the Content Validity Ratio, Aiken’s V, Intraclass Correlation Coefficient, and descriptive statistics. The findings showed that nine of twelve indicators achieved full expert agreement, while three indicators required refinement. All indicators demonstrated satisfactory clarity, with Aiken’s V values ranging from 0.80 to 0.93. The rubric also showed excellent inter-rater reliability, with an ICC value of 0.90. Ethical reflection emerged as the most prominent dimension, followed by action-oriented and affective-relational reflection, whereas cognitive reflection was less explicitly articulated. These findings indicate that the 4D Reflection Rubric is valid, reliable, and responsive to both explicit and implicit forms of teacher reflection. This study contributes a genre-sensitive assessment tool for strengthening teacher professional development, feedback quality, and institutional capacity building in educational settings.
References
[1] G. A. Koh, H. Askell-Williams, and S. Barr, "Sustaining school improvement initiatives: advice from educational leaders," Sch. Eff. Sch. Improv., vol. 34, no. 3, pp. 298-330, Jul. 2023. https://doi.org/10.1080/09243453.2023.2190130.
[2] M. Faizin, R. Sulaeman, C. Budiyanto, I. Fahmi, and M. Wahid, "Islamic Values-Based HRM and Its Impact on Student Achievement in Islamic Education," Nidhomul Haq J. Manaj. Pendidik. Islam, vol. 10, no. 3, pp. 733-748, Dec. 2025. https://doi.org/10.31538/ndhq.v10i3.243.
[3] K. Parveen et al., "The contribution of quality management practices to student performance: Mediated by school culture," Heliyon, vol. 10, no. 15, p. e34892, Aug. 2024. https://doi.org/10.1016/j.heliyon.2024.e34892.
[4] Rahmi and S. Rassanjani, "Enhancing teacher quality in Indonesia: The impact of teacher professional development on achieving sustainable development goal 4.c," Soc. Sci. Humanit. Open, vol. 12, p. 102123, 2025. https://doi.org/10.1016/j.ssaho.2025.102123.
[5] H. Li, "Reflective Practice for Pre-Service Teachers' Professional Development," SAGE Open, vol. 15, no. 3, Jan. 2025. https://doi.org/10.1177/21582440251363136.
[6] Kim, "Impact of Systematic Support in Teacher Education and Professional Development on Training-Teaching Alignment and Instructional Quality," J. STEM Educ. Res., vol. 9, no. 1, pp. 33-58, Jan. 2026. https://doi.org/10.1007/s41979-025-00154-3.
[7] S. Prayogi et al., "Emphasizing reflective processes in scientific inquiry and its impact on preservice science teachers' critical thinking skills," Soc. Sci. Humanit. Open, vol. 12, p. 101895, 2025. https://doi.org/10.1016/j.ssaho.2025.101895.
[8] T. Marshall, S. Keville, A. Cain, and J. R. Adler, "Facilitating reflection: a review and synthesis of the factors enabling effective facilitation of reflective practice," Reflective Pract., vol. 23, no. 4, pp. 483-496, Jul. 2022. https://doi.org/10.1080/14623943.2022.2064444.
[9] Y. Kolajo, "Advancing pedagogical excellence through reflective teaching practice and adaptation," Reflective Pract., vol. 26, no. 6, pp. 832-847, Nov. 2025. https://doi.org/10.1080/14623943.2025.2504143.
[10] C. K. Y. Chan and K. K. W. Lee, "Reflection literacy: A multilevel perspective on the challenges of using reflections in higher education through a comprehensive literature review," Educ. Res. Rev., vol. 32, p. 100376, Feb. 2021. https://doi.org/10.1016/j.edurev.2020.100376.
[11] M. Zohrabi and I. Xodabande, "Reflective practice as a tool for teacher education: a comparison between individual and peer reflection of Iranian EFL teachers," Discov. Educ., vol. 3, no. 1, p. 225, Nov. 2024. https://doi.org/10.1007/s44217-024-00338-w.
[12] D. Gudeta, "Professional development through reflective practice: The case of Addis Ababa secondary school EFL in-service teachers," Cogent Educ., vol. 9, no. 1, Dec. 2022. https://doi.org/10.1080/2331186X.2022.2030076.
[13] Z. Chen and R. Chen, "Exploring the Key Influencing Factors on Teachers' Reflective Practice Skill for Sustainable Learning: A Mixed Methods Study," Int. J. Environ. Res. Public Health, vol. 19, no. 18, p. 11630, Sep. 2022. https://doi.org/10.3390/ijerph191811630.
[14] D. P. Babić and K. M. Zdravković, "Empowering Education Through Collaboration: School as a Learning Community," 2026, pp. 177-193. https://doi.org/10.1007/978-3-032-19894-5_10.
[15] J. Trzebiński, J. Z. Czarnecka, and M. Cabański, "The impact of the narrative mindset on effectivity in social problem solving," PLoS One, vol. 16, no. 7, p. e0253729, Jul. 2021. https://doi.org/10.1371/journal.pone.0253729.
[16] S. Owiti, T. Bersier, and D. Hauw, "Individual differences in professional sport narrative experience during basketball players club mutation," Heliyon, vol. 7, no. 9, p. e08015, Sep. 2021. https://doi.org/10.1016/j.heliyon.2021.e08015.
[17] N. N. Makarem et al., "Grading reflective essays: the reliability of a newly developed tool- GRE-9," BMC Med. Educ., vol. 20, no. 1, p. 331, Dec. 2020. https://doi.org/10.1186/s12909-020-02213-2.
[18] H. Shafiee Rad, "Reinforcing L2 reading comprehension through artificial intelligence intervention: refining engagement to foster self-regulated learning," Smart Learn. Environ., vol. 12, no. 1, p. 23, Mar. 2025. https://doi.org/10.1186/s40561-025-00377-2.
[19] N. T. Hang, "Vietnamese EFL Teachers' Readiness and Challenges in Integrating AI-Generated Feedback," Lang. Technol. Soc. Media, 2025. https://doi.org/10.70211/ltsm.3026-7196.315.
[20] N. F. Asli, M. E. E. Mohd Matore, and M. Md Yunus, "Construct validity of primary trait writing rubrics based on assessment use argument (AUA) validation framework," Heliyon, vol. 10, no. 22, p. e40053, Nov. 2024. https://doi.org/10.1016/j.heliyon.2024.e40053.
[21] M. C. Tavares and M. Vaz, "Rethinking Performance Evaluation: Strategic Alignment in the Service Sector Through a Case-Based Framework," Adm. Sci., vol. 15, no. 10, p. 390, Oct. 2025. https://doi.org/10.3390/admsci15100390.
[22] M. Vuorre and J. Metcalfe, "Measures of relative metacognitive accuracy are confounded with task performance in tasks that permit guessing," Metacognition Learn., vol. 17, no. 2, pp. 269-291, Aug. 2022. https://doi.org/10.1007/s11409-020-09257-1.
[23] Hendriyanto, D. Suryadi, S. Sahara, D. Fardian, I. Pauji, and L. H. Muhaimin, "From tools to thought partners: Optimizing technology as extended cognition for innovative didactic design," AIP Conf. Proc., vol. 3220, no. 1, pp. 1-9, Oct. 2024. https://doi.org/10.1063/5.0234677.
[24] S. P. Phokoye et al., "Exploring the Adoption of Robotics in Teaching and Learning in Higher Education Institutions," Informatics, vol. 11, no. 4, p. 91, Nov. 2024. https://doi.org/10.3390/informatics11040091.
[25] M. Farrús, "Automatic Speech Recognition in L2 Learning: A Review Based on PRISMA Methodology," Languages, vol. 8, no. 4, p. 242, Oct. 2023. https://doi.org/10.3390/languages8040242.
[26] S. Thiagarajan, D. S. Semmel, and M. I. Semmel, Instructional development for training teachers of exceptional children. Minnesota: Indiana University, 1974.
[27] L. Daff, C. Tame, and J. Sands, "A course design approach that encourages reflective practice habits," Int. J. Manag. Educ., vol. 22, no. 2, p. 100990, Jul. 2024. https://doi.org/10.1016/j.ijme.2024.100990.
[28] G. Sherwood, "Reflective practice and knowledge development: Transforming research for a practice-based discipline," Int. J. Nurs. Sci., vol. 11, no. 4, pp. 399-404, Sep. 2024. https://doi.org/10.1016/j.ijnss.2024.08.002.
[29] H. Machost and M. Stains, "Reflective Practices in Education: A Primer for Practitioners," CBE-Life Sci. Educ., vol. 22, no. 2, Jun. 2023. https://doi.org/10.1187/cbe.22-07-0148.
[30] K. Arendt, L. Stark, A. Friedrich, R. Brünken, and R. Stark, "Quality of Reflections on Teaching: Approaches to Its Measurement and Low-Threshold Promotion," Educ. Sci., vol. 15, no. 7, p. 884, Jul. 2025. https://doi.org/10.3390/educsci15070884.
[31] F. Rombout, J. A. Schuitema, and M. L. L. Volman, "Teaching strategies for value-loaded critical thinking in philosophy classroom dialogues," Think. Ski. Creat., vol. 43, p. 100991, Mar. 2022. https://doi.org/10.1016/j.tsc.2021.100991.
[32] M. Cronqvist, "Teachers' ethical responsibility in teaching; to guide the children about right and wrong," Scand. J. Educ. Res., vol. 69, no. 4, pp. 857-870, Jun. 2025. https://doi.org/10.1080/00313831.2024.2360901.
[33] M. Gläser-Zikuda, C. Zhang, F. Hofmann, L. Plößl, L. Pösse, and M. Artmann, "Mixed methods research on reflective writing in teacher education," Front. Psychol., vol. 15, Oct. 2024. https://doi.org/10.3389/fpsyg.2024.1394641.
[34] B. A. Dean et al., "Teaching reflection in higher education curriculum: evaluation of student learning through a pre- and post-intervention," Reflective Pract., pp. 1-13, Apr. 2026. https://doi.org/10.1080/14623943.2026.2661198.
[35] Å. Diseth, "Reflection notes as a tool for professional development of pre-service psychology teachers," Reflective Pract., vol. 26, no. 6, pp. 821-831, Nov. 2025. https://doi.org/10.1080/14623943.2025.2504139.
[36] C. Vogelsang, D. Scholl, J. Meier, and S. Küth, "Thoughts Are Free-Differences Between Unstructured and Structured Reflections of Teachers with Different Levels of Expertise," Educ. Sci., vol. 15, no. 7, p. 820, Jun. 2025. https://doi.org/10.3390/educsci15070820.
[37] N. Bouizegarene, M. J. D. Ramstead, A. Constant, K. J. Friston, and L. J. Kirmayer, "Narrative as active inference: an integrative account of cognitive and social functions in adaptation," Front. Psychol., vol. 15, Jun. 2024. https://doi.org/10.3389/fpsyg.2024.1345480.
[38] T. Coppe, M. Parmentier, G. Kelchtermans, I. Raemdonck, V. März, and S. Colognesi, "Beyond traditional narratives about teacher professional development: A critical perspective on teachers' working life," Teach. Teach. Educ., vol. 139, p. 104436, Mar. 2024. https://doi.org/10.1016/j.tate.2023.104436.
[39] B. Kinnear, C. St-Onge, D. J. Schumacher, M. Marceau, and T. Naidu, "Validity in the Next Era of Assessment: Consequences, Social Impact, and Equity," Perspect. Med. Educ., vol. 13, no. 1, pp. 452-459, Sep. 2024. https://doi.org/10.5334/pme.1150.
[40] G. H. Poll, M. Mayes, and J. Petru, "Evidence to support test interpretation: Evaluating the content validity of a new item set for the Transition Pragmatics Interview," Int. J. Speech. Lang. Pathol., vol. 26, no. 6, pp. 809-819, Nov. 2024. https://doi.org/10.1080/17549507.2023.2287424.
[41] Jonsson, E. Panadero, L. Pinedo, and B. Fernández-Castilla, "Using rubrics for formative purposes: identifying factors that may affect the success of rubric implementations," Assess. Educ. Princ. Policy Pract., vol. 32, no. 2, pp. 192-211, Mar. 2025. https://doi.org/10.1080/0969594X.2025.2486947.
[42] P. Karaman, "Effects of using rubrics in self-assessment with instructor feedback on pre-service teachers' academic performance, self-regulated learning and perceptions of self-assessment," Eur. J. Psychol. Educ., vol. 39, no. 3, pp. 2551-2574, Sep. 2024. https://doi.org/10.1007/s10212-024-00867-w.
[43] H. T. Gebremariam, M. A. Tessema, M. T. Kahsay, Z. A. Mulugeta, T. W. Ambaye, and A. T. Mulatu, "Using integrated alternative assessment to explore essay writing skills: An insight into authentic instructional dashboards," Soc. Sci. Humanit. Open, vol. 11, p. 101571, 2025. https://doi.org/10.1016/j.ssaho.2025.101571.
[44] K. Kager, A. Jurczok, S. Bolli, and M. Vock, "'We were thinking too much like adults': Examining the development of teachers' critical and collaborative reflection in lesson study discussions," Teach. Teach. Educ., vol. 113, p. 103683, May 2022. https://doi.org/10.1016/j.tate.2022.103683.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Lilis Ernawati, Ribut W. Eriyanti, Masduki, Siti Agustin, Apriani Riyanti
This work is licensed under a Creative Commons Attribution 4.0 International License.