Collecting and Analyzing Data:
Process
There are five activities required in data collection and analysis;
1. Set up the database.
The database is using a statistical software package you have chosen to set up the database to capture information or transfer information from other sources.
2. Develop an evaluation plan.
The are several considerations used to evaluate performance and are used for developing tests:
* Number of participants and the amount of data to be collected
* Types of sampling method
* Confidentiality
* Costs
3. Collect and compile the data.
Capture data from the measurement instruments. Capture as much as possible.
4. Interpret the data.
Determine whether the results match the goals or not
IF the goals match the results decide to do a full-scale implementation
If results do not match goals you may
* Revise the course
* Revise the measurement instruments and tests
* Rerun the study with our without revisions
* Choose another representative sample and rerun the evaluation
* Discard the product
5. Document your findings.
Record the findings in an evaluation reprt.
Before you can analyze the data, you must set up an evaluation plan that allows you to collect the data quickly and easily. After collecting the data, you must analyze every piece according to your evaluation plan.
Monday, December 3, 2007
Sunday, December 2, 2007
First Breeze Presentation
This past week I was able to participate in a virtual class via the Breeze meeting software. I presented my Wiki page on Podcasting in a collegiate environment. The use of the breeze software was great in the fact that i was able to share my information with everyone and everyone was able to interact with me. The ability to be sitting at home and participating in class was and it demonstrated many of the topcics and resources discussed in the class.
Monday, November 26, 2007
Evaluation Plan
1) Complete the problem statement section
Step One: State the rationale for addressing the issue. Identify the problem for the organization.
Step Two: Describe the gap between the present and the desired state, describe the desired state.
2) Complete the solution section
Describe the solution for bridging the gap.
3) Complete the objectives section
State the desired performance outcomes, what will be improved when solution is implemented?
4) Complete the components of the evaluation plan for each level at which you will evaluate the project
Level 1: Reaction
*Survey construction - the content of the survey
*Data collection
*Data analysis
*Expected results
*Reporting results
Level 2: Knowledge
*Test construction
*Data collection
*Data analysis
*Expected results
*Reporting results
Level 3: Performance
*Observation study construction
*Data collection
*Data analysis
*Expected results
*Reporting results
Level 4: Impact
*Study construction
*Data collection
*Data analysis
*Expected results
*Reporting results
5) Complete the executive summary
Step one: state the problem briefly
Step two: briefly describe the solution, summary of the solution
You should not try to measure every project at the highest levels, you must set targets for measuring the levels of success. When evaluating goals the goals must fit within the corporate goals and help to ensure a positive ROI.
Step One: State the rationale for addressing the issue. Identify the problem for the organization.
Step Two: Describe the gap between the present and the desired state, describe the desired state.
2) Complete the solution section
Describe the solution for bridging the gap.
3) Complete the objectives section
State the desired performance outcomes, what will be improved when solution is implemented?
4) Complete the components of the evaluation plan for each level at which you will evaluate the project
Level 1: Reaction
*Survey construction - the content of the survey
*Data collection
*Data analysis
*Expected results
*Reporting results
Level 2: Knowledge
*Test construction
*Data collection
*Data analysis
*Expected results
*Reporting results
Level 3: Performance
*Observation study construction
*Data collection
*Data analysis
*Expected results
*Reporting results
Level 4: Impact
*Study construction
*Data collection
*Data analysis
*Expected results
*Reporting results
5) Complete the executive summary
Step one: state the problem briefly
Step two: briefly describe the solution, summary of the solution
You should not try to measure every project at the highest levels, you must set targets for measuring the levels of success. When evaluating goals the goals must fit within the corporate goals and help to ensure a positive ROI.
Virtual College Fair
This article was about a Virtual College Fair that is being hosted to allow multiple students to access information about the colleges. This fair will allow thousands of students to gain information on several colleges without the staff of the schools having to pay expensive travel bills. This will allow students to gain great information about the colleges by the staff operating the booths. This event is marketed to the millenial students born in the 80's. This event could bring many students more information about colleges and allow them to make a more informed decision without extensive traveling.
Monday, November 12, 2007
Projects coming to completion
The semester is ending soon and so are is the wiki project. I feel that i had a reasonable response to my wikis and feel content that people have gained something from the material that was posted. I think everything came together well and will provide for a decent presentation.
The design project is also moving along very well. Having to add images to the material is made much easier by the use of snagit which is allowing the materials to have the same look and feel throughout. This week should be the second evaluations before we must make video and web productions. Our team has worked well together and i believe everything will be beautiful in the end.
The design project is also moving along very well. Having to add images to the material is made much easier by the use of snagit which is allowing the materials to have the same look and feel throughout. This week should be the second evaluations before we must make video and web productions. Our team has worked well together and i believe everything will be beautiful in the end.
Multimedia Evaluations
Multimedia evaluations are used to determine if what was created was effective, it helps to determine what worked and what did not work effectively. These are questions that often go overlooked in the project process after its completion
According to Lee & Owens, evaluation of a project is very important, but often overlooked.
Lee & Owens identifies four levels of evaluation:
1. Reaction
2. Knowledge
3. Performance
4. Impact
These levels measure the impact the project had on the users. Reaction is about how a user views that the training is relevant to their tasks. Knowledge is about measuring how the users achieve an increased level of achievement through the exercise. Performance measures how what was learned affect the learner and the performance of their job over time. Impact counts on the other three levels being productive and increasing the ROI (return on investment) for the organization. Although evaluation is usually overlooked if evaluations are done well it can help increase the ability and productivity of the people who are trained.
According to Lee & Owens, evaluation of a project is very important, but often overlooked.
Lee & Owens identifies four levels of evaluation:
1. Reaction
2. Knowledge
3. Performance
4. Impact
These levels measure the impact the project had on the users. Reaction is about how a user views that the training is relevant to their tasks. Knowledge is about measuring how the users achieve an increased level of achievement through the exercise. Performance measures how what was learned affect the learner and the performance of their job over time. Impact counts on the other three levels being productive and increasing the ROI (return on investment) for the organization. Although evaluation is usually overlooked if evaluations are done well it can help increase the ability and productivity of the people who are trained.
Monday, November 5, 2007
Distance Learning
Distance learning is become a great way to obtain education. Many colleges are going to the distance learning approach including the University of Phoenix. This method of learning can provide an education for people that are not able to attend a university in Person. It seems like a good option for school if you are unable to attend, for some topics learning hands-on will be better but with the enhancement in simulation software many hands-on classes can be learned via simulations. In the future I will be considering a master's degree and the use of distance education could be a strong possibility, if I am busy working an online education may be the best option to enhance my career.
Subscribe to:
Posts (Atom)