Sub-Badge 1: Evaluate Instructional and Non-Instructional Interventions
Evaluation and Implementation
Challenge 1: Implement formative evaluation plans
Criteria for successful completion of this challenge: Evidence of implementing a formative evaluation plan to provide information that can be used to make adjustments and improvements in the design. Evidence must show a formative evaluation plan (expert review, one-to-one evaluation, small group, and field trial). Reflection must address: Which phase(s) of formative evaluation did you conduct? Which data did you collect (e.g., clarity and accuracy of instruction, general attitudes, procedural issues, etc.)? What were the results of formative evaluation and how did it affect your design?
Examples: Evaluation Plan (EDCI 528), Design Documents (EDCI 572), Learning Module (EDCI 575), eLearning Project (EDCI 569), artifacts showing strategies for implementation of an evaluation plan (design, performance, workplace, educational, other).
Reflection
Add Reflection here.
View/Download the Reflection (PDF).
Artifact:
Add description here.
View/Download (add artifact link here).
Challenge 2: Implement summative evaluation plans
Criteria for successful completion of this challenge: Evidence of implementing a summative evaluation plan to evaluate the effectiveness of the instruction and decide whether to continue to use instruction. Evidence must show an evaluation plan (e.g., Kirkpatrick’s Four Levels of evaluation). Reflection must address: If the implementation of the summative evaluation met your expectations. What were the results of the summative evaluation (did you continue with program/instruction, did you cancel it, did you modify it)?
Examples: The following assignments are applicable if implemented: Evaluation Plan (EDCI 528), Evaluation Plan (EDCI 577), artifacts showing implementation of an evaluation plan (design, performance, workplace, educational, other).
Reflection
For the challenge of implementing summative evaluation plans, I developed a detailed evaluation plan for the "Generative AI for Educators" course at the University of Texas at Austin. This plan employed Kirkpatrick’s Four Levels of Evaluation, tailored to assess the effectiveness of the instructional interventions applied throughout the course.
This artifact exemplifies my competency in creating structured evaluation frameworks that align with educational objectives and learning outcomes. It demonstrates a strategic approach to evaluation, focusing on not just immediate learning outcomes but also on long-term behavioral changes and results, which are crucial for assessing the true impact of educational interventions.
The formulation of this summative evaluation plan was significantly informed by my previous academic pursuits and practical experiences in instructional design and evaluation. Drawing on my knowledge from courses like EDCI 577, where I learned about various evaluation models, this plan reflects a synthesis of theoretical understanding and practical application, ensuring a rigorous and effective evaluation process.
Through this exercise, I enhanced my ability to critically apply theoretical models in real-world settings, underscoring the importance of evaluation in educational design. This project reinforced the value of thoughtful, ongoing assessment and taught me the importance of adapting evaluation strategies to meet specific educational needs and contexts. Moving forward, I intend to further develop my skills in dynamic evaluation, focusing on real-time feedback mechanisms to adapt and improve instructional materials continuously.
Artifact: Summative Evaluation Plan for “Generative AI for Educators” - EDCI 577
This document details the summative evaluation plan developed for assessing the long-term effectiveness of the "Generative AI for Educators" course, using Kirkpatrick’s Four Levels of Evaluation to ensure comprehensive assessment of educational outcomes.