Saturday, April 7, 2012

BISD, Lori Dudley

1.          Describe the purposes for and various stages of formative
evaluation of technology plan.
                The purpose of formative evaluation of a technology plan is to verify that
                goals outlined within the plan are actively in place, properly in use, and
                assessment occurring. The various stages promote the desired outcome
                over time.

                   
                                                         (Williams, n.d)
      Within a technology plan one must design a plan and make sure the intended goal matches
      the needs assessment.

      Formative evaluation helps find out if the plan is achieving the intended goals and
      objects in the formative stages of the technology plan
      Formative evaluation provides:
  • A chance to test the ideas and implement changes before completing the entire plan
  • A way to test both the form and content of the technology plan developed
2.       Describe your instruments used in a formative evaluation.

·         Establish and train the evaluation committee
·         Formulate and review evaluation questions
·         Collect data using surveys, focus group interviews, and classroom observation
·         Present findings and recommendations in a final report

   Overview of the Project
Objectives of the Technology-facilitated

   Learning Environment

Objectives of the Evaluation
Audiences/stakeholders for the evaluation
   study
Available Resources
Action Inquiry Cycle and Action Plan
Data Collection and Analysis Methods
Budget
 (Sun Associates, 2012)
3.       Collect data according to a formative evaluation plan for a given
          set of technology plan or instructor presentation.

            According to BISD Superintendent and Academic Coordinator the collected data
           is reflective through the STaR charts upon completion of teacher’s knowledge
           and use of technology. Addition data is collected through district surveys that
           express direct needs of technology training.

            Formative evaluation can be conducted upon the output of each stage of  
             design order to make revisions before any actual development of materials  
             takes place. Smith & Ragan (1999) include the following as part of the design
             review phase of formative evaluation”(Smith & Ragan, 1999)

                Goal Review      
                Conduct a formal needs assessment and have the client review the learning
                goal(s) once stated in formal performance terms.

                Review of Environment and Learner Analysis

                After data has been collected from an environmental and learner analysis,      
                the instructional designer should review its adequacy. This may include
                collecting additional information to either confirm or extend the initial analysis.

                Review of Task Analysis            

                Confirm the prerequisite relationship of skills by testing two separate groups
                of learners. One group of learners who have the targeted skills and another
                group of learners who do not. Learners that can achieve the terminal
                objective should  also be tested to see if they can also perform the enabling
                objectives. It is also a good idea to have other instructional designers to
                review the task analysis for accuracy and completeness.

                Review of Assessment Specifications and Blueprints        

                Have content and testing experts review assessment items and blueprints
                for the congruence of the objectives and test item specifications and verify
                if the type of items outlined in the specifications sufficiently describe and
                are representative of the domain. Skilled learners can also be administered
                test items before the materials are developed to determine reliability of
                the items.
          (Smith & Ragan, 1999)

References:
Sun Associates (2012). Program Evaluation Services. Retrieved (2012, April 6) from
 http://www.sun-associates.com/evaluation.html

Smith, P. and Ragan, T. (1999). Instructional design (2nd ed.). New York:
John Wiley & Sons, Inc.
Williams, B. (n.d) Formative evaluation has six steps. Retrieved (2012, April 5) from https://www.courses.psu.edu/trdev/trdev518_bow100/D_C10present/sld004.htm

5 comments:

  1. Lori,
    I found the resources of EdTechEval.org to be very helpful as well. I know that many grants require recipients to provide formative evaluation information. Most of these reports seem to be conducted by consulting services. Why, in your opinion, would they provide copies of their surveys, matrices and interview questions free of charge on their website?

    ReplyDelete
  2. Allison,
    I have not view edtecheval.org but many companies posted items on the internet that are still copyrighted and not actually free although some do fall under public domain.

    ReplyDelete
  3. Lori,

    Thanks for the great post. I'm glad to see that your district also relies on addition surveys outside of the STaR chart. How well do you feel that this information is used in assessing the current technology plan? Do the campuses ever get their hands on this information?

    ReplyDelete
    Replies
    1. Since our district is rather small the answer to your second question is YES, however budget cuts limit the strategies needed to implement. The information is a vital part of the creation of a technology plan - the meetings that I was part of this year showed that the administration is aware of issues and place the goals on the plan BUT fail to implement within the 3 years as indicated therefore the same goal is carried on to the next plan. Thisis sad but a very true FACT!

      Delete
  4. This comment has been removed by the author.

    ReplyDelete

Note: Only a member of this blog may post a comment.