EdTech 505: Apply Gap Analysis

Kim Hefty

EdTech 505

Week 5 Assignment: Apply Gap Analysis to the program/project you detailed in exercises in chapters 1 & 2.

Topic/Project Description:

Private tutors exist in nearly every level of education.  Tutors have very little control, if any, of their student’s evaluations, yet are expected to improve a student’s academic performance.  A student’s classroom teacher decides the student’s evaluations.  How can a tutor improve their student’s performance?   Can technology assist with this process?

The purpose of this project is to evaluate the usage and effectiveness of study guides given to high school juniors taking an online algebra 2 course.  The goal is to improve student performance on online assignments and exams.

Evaluation Process

There are a total of twelve juniors taking online algebra 2.  I have randomly divided them into two groups of six.  Because the course is online, I can gather data on assignment and exam scores, amount of time spent on assignments and tests, and amount of time spent viewing the lesson. For the first unit no students were given any supplemental materials.  For the second unit all students will be given the same study guide.  I will also be surveying the students prior to lesson 1, after lesson 1, prior to lesson 2 and after lesson 2. I would also like to develop a survey for students that could include program satisfaction.

  1. Gap Analysis

Leg A: Assessing Needs

Through informal discussions and using a survey with multiple stakeholders: students, parents, and the local school district I will analyze and clarify the development of my goals.

Potential Discussion and Survey Questions for Leg A

  • How much time do you spend online viewing the lessons? (the nice part is that I can actually verify this)
  • What were your grades in math for the past two years?
  • Do you take notes?
  • How do you prepare for exams?

 

Leg B: The Bridge

The bridge will be how to get to the future goals. The ultimate goal is to improve academic performance using study guides. The use of the study guides will, of course, be part of the solution, but teaching and reinforcing the use of the study guide will be a key component.

Potential Discussion and Survey Questions for Leg B

  • How much time did you spend on the study guide for unit 2?
  • Did you feel that it helped? If so, how?
  • What aspects of the study guide did you like?
  • What aspects would you change?
  • Did the study guide increase the amount of time you spent on the lesson?

Leg C: Future Goals

The ultimate goal is to improve academic performance and to help the students achieve this performance in a more efficient manner. Evaluation will allow me to measure the relative performance with and without the availability of the study guides.

Potential Discussion and Survey Questions for Leg C

  • Do the study guides increase the amount of time spent on lessons?
  • Does the study guide increase the amount of time spent preparing for exams?
  • Do the study guides improve performance?
  1. Explain Figure 3.1 “Program Cycle”

Figure 3.1 presents the “Program Cycle” as a cyclical process rather than a linear process.  I have been doing my evaluation planning assuming the process was more linear than cyclical.  But it makes more sense to adjust and adapt as my project develops.  I will also add an arrow back to my philosophy and goals from every step.  I think that it is critical to constantly reevaluate and monitor my goals as the evaluation progresses.

In terms of my project I need to clearly add evaluation during the program planning and needs analysis phases.  Evaluation will provide critical feedback during all phases and stages.  I also need to include all stakeholders, not just the obvious ones, especially during the programming planning.

I need to reevaluate my goals keeping an evaluators perspective in mind.  Upon closer examination of the model I see that I also need to more clearly add a formative evaluation component; my project primarily is set up for a summative evaluation.  I completely agree with the authors “the results of the evaluation are to improve the project.”

Boulmetis, J., & Dutwin, P. (2011). The ABCs of evaluation (3rd ed.). San Francisco, CA: Jossey-Bass.

Extra Credit

Locate an Internet site relating to “program cycle”

http://www.cglrc.cgiar.org/icraf/toolkit/The_CIPP_evaluation_model.htm

http://www.ehow.com/how_7840489_use-cipp-model-program-evaluation.html

 

I chose these two websites to be used together. The first is an outline of the actual CIPP model; the second site shows the reader “how” to use this model. The CIPP model provides a systematic approach to analyzing the curriculum development process.   This process consists of four different elements: Context, Inputs, Process and Product. The sites also present multiple methods for evaluation such as discussions, tests, questionnaires, and interviews. This model is considered more “holistic” than many other models.

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s