Monday, April 9, 2012

Elementary - Donzella Manuel Week 11

Revise Technology Plan /  Design and Conduct Summative Evaluation

1. Describe the purposes for and various stages of formative evaluation of technology plan.

The purposes for a formative evaluation of technology plan is to allow you to gather feedback on whether you are meeting your goals and objectives during the planning and development of your technology plan rather than waiting until the technology plan is complete. Formative evaluations assess what works and what does not work for your technology plan.

There are four stages of formative evaluation:

Stage 1 -  Expert review(s) / Internal review (Technology Plan Committee)
The Technology Plan Committee review the technology plan for accuracy and completeness.

Stage 2 -  One-to-One evaluation
The designer works with individual learners to obtain data to revise the technology plan. The learner at a time reviews the content of the lessons using technology and give comments upon it. The purpose is to identify problems in the instruction, such as typographical errors, unclear sentences, poor or missing directions, etc.

Stage 3 - Small group evaluation / Tutorial and small-group tryouts
During small group evaluation of 8-20 learners/teachers (target population), the evaluator tries out the instruction with the group of learners and records their performances and comments. The output of a small group evaluation is a revised instructional lesson based upon time, performance and attitude.

Stage 4 - Field trial / Field test / Operational tryout
During a field test instruction is evaluated in the same environments in which it will be used when it is finished. The goal of the field trial is effective instruction the yields desired levels of learner achievement and attitudes and that functions as intended in the learning setting.
          

2. Describe your instruments used in a formative evaluation.

Formative evaluation relies on many of the same techniques that other forms of assessment use. Evaluation instruments that are used for a school/district technology plan is surveys, interviews, monitoring/observation, reports, logs. The instruments I used in the formative evaluation for my technology plan is survey/questionnaire, interviews, log and monitoring/observation. 

3. Collect data according to a formative evaluation plan for a given set of technology plan or instructor presentation.

 The accountability methods and measures that will be used to evaluate the extent to which activities are effective are:

Technology
Integrating technology into curriculum and instructions, I used a survey/questionnaire, interviews monitoring/observation, and a log to collect data during the formative evaluation stage.

Funding
A carefully developed technology plan will help to make sure that my district have secured the resources needed. The budget must include estimated costs with available and potential funding sources for all areas addressed in the plan. I used monitoring/observation of the elementary schools technology budget during the formative evaluation stage.

Management
Increasing the ability of teachers to teach and learn technology with professional development, I used a survey, monitoring/observation and a log to collect data during the formative evaluation stage.


References:

Dick, W. and Carey, L. (1996). The Systematic design of instruction, 4th ed. New York: Harper Collins Publishing.

TPESC. (n.d.). Technology Plan Components - Evaluation. Retrieved March 3, 2012, from http://tpesc.esc12.net/eplan/Evaluation.html

6 comments:

  1. In addition to the instruments you described using with your formative evaluations, I found a website with great recommendations. Some suggested means for evaluation include: "test for criterion-related referenced items, provide means for anonymous feedback as well as face-to-face" and evaluate your instruments for "clarity, reliability, and accuracy" (Strickland, n.d.). Do you think these suggested means could be beneficial to your instruments you have already listed?

    Strickland, A. (n.d.). ADDIE - Sample Evaluation Plan. College of Education | Idaho State University. Retrieved April 11, 2012, from http://ed.isu.edu/addie/evaluate/evalua

    ReplyDelete
    Replies
    1. Robyn,
      Both face-to-face and anonymous feedback could be beneficial to my instruments I have listed. I think the anonymous feedback would allow the surveyors to be more open and honest with with their feedback because the evaluator have no idea who they are.

      Delete
  2. Donzella,
    I found many different methods of collecting information. Two methods I think are important to consider are baseline data and pilot testing. Baseline data are used to set benchmarks and to determine the amount of change at different points in the course of the program. For example, if you wanted to find out if teacher use of technology increases after professional development, it would be best to collect information on use both before and after the activity. Pilot testing is used to catch potential problems before they become costly mistakes. It is typically used if an instrument or method of data collection is being used for the first time or for the first time with a particular group. Pilot testing provides information on how long data collection can be expected to take and a preview of how difficult items will be to complete (Quiñones & Kirshstein, 1998). Do you think any of these methods would be useful to collect data for your technology plan?

    Quiñones, S. & Kirshstein, R. (1998). An Educator’s Guide to Evaluating the Use of Technology in Schools and Classrooms. Retrieved from http://www.au.af.mil/au/awc/awcgate/ed-techguide/handbook2.pdf

    ReplyDelete
    Replies
    1. Angela,
      Yes, both can be used to collect data for my technology plan, but I think baseline data would be the one I would prefer to use. Checking to see if teachers are using technology more after professional development is a better idea.

      Delete
  3. Donzella, when surveying or interviewing the learner, will the learner be defined as a current student? Have you considered including former students in this process? It's something I think I will include with my evaluation of the district's technology plan. I think this will allow us to see if we truly prepared our students for success in college and/or life beyond high school. Who else might we include in our evaluation process (college professors of former students, employers of former students, etc)?

    Joy

    ReplyDelete
    Replies
    1. Joy,
      Yes the learners would be current students. I have not considered former students, but I think it is an excellent idea to use former students. I think college professors of former students would be a good target to survey or interview.

      Delete

Note: Only a member of this blog may post a comment.