Development of a Graded Observation Form for Assessing Secondary School Students' Engineering Entrepreneurship

Abstract

This study aimed to develop an observation form with a rubric for group assessment of students' engineering entrepreneurship. The Educational Design Research was used in the development of the measurement tool. The process was based on the "analysis and exploration," "design and construction," and "evaluation and reflection" stages of McKenney and Reeves' (2012) model. During the analysis and exploration phase, a literature review and document analysis were conducted, and the dimensions were determined. During the design and construction phase, an item pool was created, a draft form was developed, and four experts were consulted. During the evaluation and reflection phase, the developed form was applied to 32 sixth-grade students in the engineering design process conducted in the science lesson and density subject for four weeks in the 2023-2024 academic year. The video recordings and observation notes obtained during the process were analyzed and coded by another expert, and the codes were compared. Face and content validity of the developed form were established, and reliability analysis revealed 96% intercoder consistency. As a result, a valid, reliable, and useful graded observation form was developed, comprising 26 items across eight dimensions: leadership, innovation, creativity, risk-taking, time management, teamwork, effective communication, and marketing. The evaluation criteria for each item in the form are clearly defined. Additionally, the "description" section on the form allows the observer to note qualitative observations or noteworthy events. The developed form is suitable for use in studies using all research methods. Teachers can use this form for formative assessment purposes.