Prudence dictates that investment decisions for any new project, whether it is commercial or non-profit in nature, must be predicated upon a solid business case of value delivery. While some social programs might be justified even though there might not be a monetary value to them, most initiatives in the business world are tied to demonstrable value, either in productivity or monetary terms. Corporate training initiatives fall within that category. Level 4 Training Evaluation - The key to measuring training value Deceptively impossible Achieving "real" results is the ultimate objective of any company's training initiatives. Organizations typically won't invest in a training program unless management is convinced that the proposed training will lead to specific benefits. The challenge that most corporate trainers face however is: How does one measure "real" organizational impact as a result of training? And the answer is: Through a Kirkpatrick Level 4 Evaluation. And when Level 4 … [Read more...] about Level 4 Training Evaluation
Evaluation
Guide to ELearning Analytics: Judging eLearning success beyond grades and course completion rates
Typically, a project (regardless of which industry it originates in) is deemed “successful” if it ends well. Putting that in eLearning context then, a popular consensus among course developers and moderators is that the course is a success if: A higher number of learners sign up for it, compared to the previous iteration A larger number of learners have completed the course successfully The amount of revenue earned, per learner, steadily rises over time While these metrics point to some form of eLearning success, they are usually measured “after the fact” – i.e., once the course is over. Today, this traditional model of measuring eLearning is considered obsolete. With eLearning analytics, course providers are measuring courses in real time – from the time a learner signs up, until they finish the final evaluation, and at every stage in-between. ELearning Analytics 101 ELearning analytics is a data-driven model to evaluate and assess the success of a course. These … [Read more...] about Guide to ELearning Analytics: Judging eLearning success beyond grades and course completion rates
How to Engage ELearners Through Questioning Techniques
Questioning learners has always been a very effective tool in the arsenal of instructors. In an eLearning context however, because of the physical separation of teachers and learners, the use of questioning techniques attains even more relevance. What course developers and instructors can’t assess through visual observation and in-person interactions, they must accomplish through innovative questioning techniques. 5 ELearning Questioning Strategies Before online course developers and instructional designers start creating their question banks, it is vital to understand the objectives that are sought to be accomplished from the questions. Questions should then be built around a comprehensive strategy, which key elements should include: Communication: Using strategically designed questions, evaluate whether there is a high degree of communication between learners and instructors. If the response reveals lack of good communication, then your instructional … [Read more...] about How to Engage ELearners Through Questioning Techniques
To Score or Not to Score?
Instructional designers, especially those who work on federal contract, often experience the dilemma as to whether or not they should score assessments. While some believe that assessments must be scored; there are others, who do not feel that way. Learners who like scored assessments feel that knowing how they did on the test helps them master the content. You probably noticed that often, when you take an assessment and get the question wrong, you receive the following type of feedback: “Sorry, but you did not get it right.” There are learners who are afraid of failure and feel that scored tests are a pedagogical approach to learning not suitable for adults who simply need guidance to achieve better performance results, not scores. In spite of negative attitudes, scored assessments provide information to management about learners’ progress and determine whether the learner is ready to move on to the next, more advanced level. When it comes to assessments instructional … [Read more...] about To Score or Not to Score?
5 Parts Of Corrective Feedback In ELearning
As an instructional designer, I know that Level 2 evaluation plays a significant role in ensuring that learners truly understand the presented material. While most e-Learning courses contain some type of test or quiz, many do not bother to provide adequate feedback. In fact, feedback, plays a crucial role in helping learners progress towards their goals and understand whether they have mastered the content from the course. The main goal of corrective feedback is to provide remediation and promote learning. The feedback that learners receive can be either intrinsic or indirect or extrinsic or direct. The type of course, presentation methods, and assessment instruments chosen determine the type of feedback you provide. For example, while extrinsic feedback may be a good choice for multiple-choice questions, it may not work well for a game. Instructional designers should carefully construct corrective feedback for each question to ensure that it covers all objectives of the … [Read more...] about 5 Parts Of Corrective Feedback In ELearning
3 Ways To Make Your Multiple-Choice Questions More Effective
In the last post, we looked at some ways to make your multiple-choice questions effective. In this post, I will suggest some other ways to make your multiple-choice items more reliable. Avoid negatives. Oftentimes, learners overlook the word not and, as a result, choose an incorrect response. It is a good practice to record your stems whenever possible. If the stem cannot be reworded, bolding, underlining, or capitalizing the negatives will draw the learners’ attention to these negatives and help them concentrate on the actual question. Also, if instructional designers absolutely have or want to include negatives in their questions, it is suggested to add them at the end of the question stem and use capital letters to bring attention to them. For example: All of the following are ways to make your assessment items reliable EXCEPT: Avoid revelation of correct response. The stems should be written in a way that does not automatically reveal the correct response to any of the … [Read more...] about 3 Ways To Make Your Multiple-Choice Questions More Effective