More Questions for Level 1 eLearning Evaluation

When you need to evaluate the effectiveness of your eLearning modules and courses, there’s no better place to start than the tried-and-true Four-Levels Model developed by Douglas Kirkpatrick. In my last article on this, Level 1 Evaluation for eLearning: Reaction, I presented 19 questions in the categories of learning objectives and content. Now it’s time to dive right in with many additional questions in several more categories so you have a pool of questions to choose from when designing your own Level 1 eLearning Evaluation tool.

Download the free white paper How You Can Assess The Effectiveness of Your Training –  Kirkpatrick Model Learning Assessments

• Rate how relevant the assignments, quizzes, and tests were for you (1-10, 1 is low, 10 is high).
• Rate the quality of questions used in the quizzes (1-10, 1 is low, 10 is high).
• Rate the variety of types of quizzes (1-10, 1 is low, 10 is high).
• Rate the timeliness of quiz feedback (1-10, 1 is low, 10 is high).
• Rate the usefulness of quiz feedback in terms of helping your learning (1-10, 1 is low, 10 is high).
• Rate the frequency of quizzes by circling one of the following: Too many, too few, just right.
• Rate how well the quizzes aligned to course content (1-10, 1 is low, 10 is high).
• How might the exams be improved? (open-ended).
• Rate the usefulness of the review sections prior to quizzes (1-10, 1 is low, 10 is high).

Time Spent and Pacing

• How much time did you spend on this e-learning course? (average hours per day or week or month, depending on course length).
• How much time did you spend on course-related activities such as discussion groups? (average hours per day or week or month, depending on course length).
• Rate the appropriateness of the amount of time it took to finish this course or module (1-10, 1 is low, 10 is high).
• Rate the pace at which the course or module proceeded by circling one of the following: Too fast, too slow, just right.

eLearning Logistics

• Rate how available the instructor was during the course (1-10, 1 is low, 10 is high).
• Rate the opportunity to interact with others in the course/module (1-10, 1 is low, 10 is high).
• Rate the ease of navigation in the eLearning environment (1-10, 1 is low, 10 is high).
• Rate how easy it was to access the content of the module or course (1-10, 1 is low, 10 is high).
• Rate the availability of technical support (1-10, 1 is low, 10 is high).
• What were some of the more frustrating technical problem you encountered during the course or module? (open-ended).
• Rate the overall aesthetic of the materials presented (1-10, 1 is low, 10 is high).
• Please comment on the visual design of the course (open-ended).
• Rate the legibility of the text and fonts used (1-10, 1 is low, 10 is high).

Multimedia

• Rate the amount of multimedia in terms of audio, video, and animation by circling one of the following: Too little, too much, just right.
• Rate the quality of multimedia in terms of audio, video, and animation (1-10, 1 is low, 10 is high).
• Rate the amount of photography used by circling one of the following: Too little, too much, just right.
• Rate the quality of the photography (1-10, 1 is low, 10 is high).
• Rate the amount of audio used by circling one of the following: Too little, too much, just right.
• Rate the quality of audio (1-10, 1 is low, 10 is high).
• Rate the amount of narration by circling one of the following: Too little, too much, just right.
• Rate the quality of the narration (1-10, 1 is low, 10 is high).
• How could the multimedia elements of the course or module be improved? (open-ended).
• Rate your satisfaction with any group work that took place (1-10, 1 is low, 10 is high).

Overall Experience

• Rate your enjoyment of the course (1-10, 1 is low, 10 is high).
• Rate the workload of the course or module by circling one of the following: Too little, too much, just right.
• What would you say were the greatest the strengths of this module or course? (open-ended).
• What would you say were the greatest the weaknesses of this module or course? (open-ended).
• Rate the technical quality of the course materials (1-10, 1 is low, 10 is high).
• Rate how confident you now feel about your knowledge of the topic (1-10, 1 is low, 10 is high).
• List the top three things you learned in this course or module (open-ended).
• How would you improve this e-learning course? (open-ended).
• Rate how likely would you be to recommend this course or module to a colleague (1-10, 1 is low, 10 is high).

That concludes what needs to be said about Kirkpatrick’s Level 1 evaluation to measure the reaction of the audience to your eLearning course or module. In the next article I’ll tackle the details of what’s involved in Level 2 evaluation: Learning.