EdTech 505: Writing the Evaluation

Kim Hefty

EdTech 505

Week 4 Assignment: Writing the Evaluation

  1. Written Submission:

Topic/Project Description:

Private tutors exist in nearly every level of education.  Tutors have very little control, if any, of their student’s evaluations, yet are expected to improve a student’s academic performance.  A student’s classroom teacher decides the student’s evaluations.  How can a tutor improve their student’s performance?   Can technology assist with this process?

The purpose of this project is to evaluate the usage and effectiveness of study guides given to high school juniors taking an online algebra 2 course.  The goal is to improve student performance on online assignments and exams.

Evaluation Process

There are a total of twelve juniors taking online algebra 2.  I have randomly divided them into two groups of six.  Because the course is online, I can gather data on assignment and exam scores, amount of time spent on assignments and tests, and amount of time spent viewing the lesson. For the first unit no students were given any supplemental materials.  For the second unit all students will be given the same study guide.  I will also be surveying the students prior to lesson 1, after lesson 1, prior to lesson 2 and after lesson 2. I would also like to develop a survey for students that could include program satisfaction.

Potential Survey Questions

The goal of the study guides is to improve student performance and knowledge.

  • Do the study guides increase the amount of time spent on lessons?
  • Does the study guide increase the amount of time spent on exams?
  • Do the study guides improve performance?
  1. a. Question & Exercises p. 202

Do I need to write a final evaluation report?

Yes! In order to is an effective and efficient tutor that the school district and parents can rely upon I need to be able to show credible evidence that what I am doing improves student performance. An evaluation reports will show statistical evidence that the study guides that I can uniquely provide will have a significant impact.

For whom do I write the evaluation report?

The report will be for my company, Sammamish Mathematics, the local school district that 99% of my students attend, and the parents of my students as well as potential future clients.

What are the key components of my evaluation report?

My evaluation report will contain the following:

  • Cover Page
  • Overall Summary
  • Table of Contents
  • Introduction
  • Methodology of Evaluation

Evaluation Design

  • Results and Findings of Evaluation
  • Summary and Recommendations
  • Appendices (including copies of surveys, statistics, and study guides)
  1. c. Appendices B & C Discussion

Appendix B explores evaluation reports. It provides a detailed example of “Zoo in the Community.” The introduction is concise and limited. The introduction provides the evaluation model. The methodology explains how the evaluation was designed. It also outlines specific objectives. Instrumentation describes the details of the surveys developed and their respective purpose. The analysis provides the results and how they were compiled and reviewed. The results are reported in terms of the objectives. The data is presented with each objective individually. Tables and specific reports are presented within the results. Recommendations are made based on the results and reported to the appropriate stakeholder. The recommendations can be specific or general and can move into a completely new territory.

The actual surveys are given, beginning with a self-concept questionnaire.   Participants are asked to identify whether or not they identify with series of statements. The statements are emotionally driven in nature, such as I’m understood or I’m easy to like. Many of the statements are definitive using terminology such as “always” or “never”. Another other part of Appendix B asks the evaluator to determine Semantic Differential. Most of the options are complete opposites of one another such as “interesting” vs. “uninteresting.” The final section is a Self-Evaluation form for potential employees of the zoo. The respondents are ask to rate themselves on a series of traits relevant or necessary to work at the zoo. All three of the example forms are inquiring into the respondent’s attitudes or opinions. All of the evaluations are subjective. The three forms also show a variety of approaches to surveys … a yes/no format, a sliding scale, and a ranking system.

Appendix C was a Sample Evaluation Contract. It begins with the evaluation questions followed by an evaluation plan. The plan is separated by goals. Each goal is broken into activities, data source, and data collection methods. The collection is pre-survey, post survey, or interim. The contract concludes with project expenses.

Of the two appendices evaluated I preferred appendix C. It was more concise and easier to follow. However, I felt the conclusion or evaluation was too brief to have a significant impact.

  1. Extra Credit
  2. Locate a website supplemental to Appendix B

http://web.undp.org/evaluation/handbook/Annex7.html

I chose this website for a few reasons. It provides a template for users to fill in. I liked how it mirrored what our text book has been saying for the content of an evaluation report. It describes not only what the sections should be in the report but provides extensive detail for each section. I only wish this was more generic, and then I could use it for my project!

 

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s