Evaluation Basics

Getting training delivered is certainly an accomplishmenttest for skills and behaviors. This type of testing is
in this troubled economic environment. But you mustdirect testing of the objectives of the program. For
take the time to determine if participants understoodexample, if you've trained customer service agents,
and are able to apply the objectives of the traininghave them set up a customer account from beginning
program. Otherwise, you have wasted valuable timeto end within an acceptable margin of error. Or, if
and effort. Evaluation, or testing, is used to determineyou've trained phone representatives, have them take
the success of a program. You can evaluate thescripted calls on the subjects in the program, also
instruction itself (formative evaluation), which isgraded using certain criteria and within a margin of
something you should be doing at all times. But there isacceptable error. Skills and behavior evaluation can
also the matter of evaluating how well the participantstake the form of observed role plays, checklists that
learned the objectives (summative evaluation), and thismake sure a participant is achieving operational steps
is sometimes "thrown in" as an afterthought. Let's lookor procedures, or even peer evaluation of a customer
at some specifics on testing participants.service interaction. In other words, you'll need to
The first thing you'll need to do is determine whatconduct "real" tests of "real" activities.
you're testing. Is the program simply aimed at newFinally, evaluating attitudes can sometimes be difficult.
knowledge, such as a new product offering? Or areAn attitude could be the attitude of the participant
you training an entire way of doing something, such astoward the training, the outcome of the training
a new position, new sales processes, or operationalprogram, or their own behavior. For example, your
processes? Do you want to see how the attitudes oftraining may enable participants to eventually promote
the participants changed as a result of the training?from one level to another within a job group. You may
The program could even be a combination of all ofwant to evaluate the attitudes of the participants
these areas, so becoming aware of the outcomestoward their jobs and the training by determining how
and how they are tested will help you figure out howmany of them promoted within a certain amount of
to create meaningful evaluation. Keep in mind thattime. Or, you may need to interview the participants'
testing does not have to be intimidating. You cansupervisors at certain points after the training program
integrate a "testing feel" throughout the program byoccurs. This type of evaluation can show you if the
offering knowledge checks, hands-on activities, andparticipants accepted the new knowledge, applied it to
role-plays in every segment.their jobs, and used it to increase their own skills. As
Knowledge testing is probably used more often thanwe discussed, this can sometimes be difficult to
any other kind of testing. But make sure that whatdetermine and measure, but even in small amounts it's
you're looking for is knowledge; if the participants needworthwhile to discover how training affected
to show you how to do something, don't just ask themparticipants' attitudes.
to describe it on paper. We will discuss this type ofEvaluation can occur in steps, as well. If you're not sure
evaluation in a moment. For knowledge testing, paperwhich way to go, start out by evaluating knowledge
or computer based tests work the best. These areand then moving up to the other levels as you go
objective tests that use multiple choice, true-false,along. If you know that participants need to do
matching, completion, and even essay style questions.something, combine knowledge evaluation with skills
Don't make them too easy. For example,and behavior evaluation to determine if participants
multiple-choice tests should have reasonable choicesunderstood the knowledge and are able to apply it.
for possible answers, but be careful not to give themYou can always add attitude evaluation at a later point.
away by making them blatantly obvious, either.Testing and evaluation does not have to be intimidating
Participants should be able to pick out correct answersfor you or the participants. Think about what you're
simply based on the knowledge they've absorbed.evaluating and begin a program. You'll discover what
When you need to have participants show you thatparticipants are learning - and the effectiveness of the
they've understood how to do something, you'll need totraining design and delivery.