1. Describe the purposes for and various stages of formative
evaluation of technology plan.
The purpose of formative evaluation of a technology plan is to verify that goals outlined within the plan are actively in place, properly in use, and
assessment occurring. The various stages promote the desired outcome
over time.
(Williams, n.d)
Within a technology plan one must design a plan and make sure the intended goal matches
the needs assessment.
Formative evaluation helps find out if the plan is achieving the intended goals and
objects in the formative stages of the technology plan
Formative evaluation provides:
- A chance to test the ideas and implement changes before completing the entire plan
- A way to test both the form and content of the technology plan developed
· Establish and train the evaluation committee
· Formulate and review evaluation questions
· Collect data using surveys, focus group interviews, and classroom observation
· Present findings and recommendations in a final report
Overview of the Project
• Objectives of the Technology-facilitated
Learning Environment
• Objectives of the Evaluation
• Audiences/stakeholders for the evaluation
study
• Available Resources
• Action Inquiry Cycle and Action Plan
• Data Collection and Analysis Methods
• Budget
(Sun Associates, 2012)
(Sun Associates, 2012)
3. Collect data according to a formative evaluation plan for a given
set of technology plan or instructor presentation.
According to BISD Superintendent and Academic Coordinator the collected data
is reflective through the STaR charts upon completion of teacher’s knowledge
and use of technology. Addition data is collected through district surveys that
express direct needs of technology training.
“Formative evaluation can be conducted upon the output of each stage of
“Formative evaluation can be conducted upon the output of each stage of
design order to make revisions before any actual development of materials
takes place. Smith & Ragan (1999) include the following as part of the design
review phase of formative evaluation”(Smith & Ragan, 1999)
Conduct a formal needs assessment and have the client review the learning
goal(s) once stated in formal performance terms.
Review of Environment and Learner Analysis
After data has been collected from an environmental and learner analysis,
the instructional designer should review its adequacy. This may include
collecting additional information to either confirm or extend the initial analysis.
Review of Task Analysis
Confirm the prerequisite relationship of skills by testing two separate groups
of learners. One group of learners who have the targeted skills and another
group of learners who do not. Learners that can achieve the terminal
objective should also be tested to see if they can also perform the enabling
objectives. It is also a good idea to have other instructional designers to
review the task analysis for accuracy and completeness.
Review of Assessment Specifications and Blueprints
Have content and testing experts review assessment items and blueprints
for the congruence of the objectives and test item specifications and verify
if the type of items outlined in the specifications sufficiently describe and
are representative of the domain. Skilled learners can also be administered
test items before the materials are developed to determine reliability of
the items.
(Smith & Ragan, 1999)
References:
Sun Associates (2012). Program Evaluation Services. Retrieved (2012, April 6) from
http://www.sun-associates.com/evaluation.html
http://www.sun-associates.com/evaluation.html
Smith, P. and Ragan, T. (1999). Instructional design (2nd ed.). New York:
John Wiley & Sons, Inc.
John Wiley & Sons, Inc.
Williams, B. (n.d) Formative evaluation has six steps. Retrieved (2012, April 5) from https://www.courses.psu.edu/trdev/trdev518_bow100/D_C10present/sld004.htm
Lori,
ReplyDeleteI found the resources of EdTechEval.org to be very helpful as well. I know that many grants require recipients to provide formative evaluation information. Most of these reports seem to be conducted by consulting services. Why, in your opinion, would they provide copies of their surveys, matrices and interview questions free of charge on their website?
Allison,
ReplyDeleteI have not view edtecheval.org but many companies posted items on the internet that are still copyrighted and not actually free although some do fall under public domain.
Lori,
ReplyDeleteThanks for the great post. I'm glad to see that your district also relies on addition surveys outside of the STaR chart. How well do you feel that this information is used in assessing the current technology plan? Do the campuses ever get their hands on this information?
Since our district is rather small the answer to your second question is YES, however budget cuts limit the strategies needed to implement. The information is a vital part of the creation of a technology plan - the meetings that I was part of this year showed that the administration is aware of issues and place the goals on the plan BUT fail to implement within the 3 years as indicated therefore the same goal is carried on to the next plan. Thisis sad but a very true FACT!
DeleteThis comment has been removed by the author.
ReplyDelete