Communications- Ch. 12 Implementing & Evaluating Learning

job instruction training

prepare the learner

present the operation

try out performance

follow-up

what kind of techniques would you use for cognitive learning domain?

lectures, discussion,
simulation, demonstration, audio-visual
assisted instruction

what kind of techniques would you use for affective learning domain?

audiovisual or
guided instruction for the lower levels;
discussion, active involvement,
problem-solving, and modeling for the
higher levels

what kind of techniquess would you use for psychomotor domain?

demonstration,
direct experience, practice

what are some data collection instruments?

Tests or Exams
• Questionnaires
• Interviews
• Observation
• Performance tests
• Self-reports
• Rating scales

Which data collection instrument is most appropriate for measuring learning outcome in cognitive domain? (knowledge, intellectual skills)

Tests/Exams, Questionnaires

Which data collection instrument is most appropriate for measuring learning outcome in Affective domain? (attitudes, values, feelings)

Interviews, Self-reports, Rating scales

Which data collection instrument is most appropriate for measuring learning outcome in Psychomotor domain? (physical skills/abilities)

Observation, Performance tests

measurement

The collection of data
• Determines degree to which a person possesses a
certain attribute

evaluation

Based on measurement of what people know, think,
feel, and do
• Compares the observed value or quality with a standard
or criterion
• Implies judgment

Evaluating learning

A systematic appraisal of the quality and
effectiveness of teaching

implies advance planning

many purposes for evaluation….

Judgments about effectiveness
• Identify strengths and weaknesses
• Determine the need for change

what are the 2 types of evaluation

1) formative

2) summative

formative evaluation

Systematic appraisal that occurs before or during the
implementation of a learning activity for the purpose of
modifying or improving teaching, learning, program
design

summative evaluation

Conducted at the end-point of learning
• Used at the conclusion of a learning activity to appraise
results, quality, outcomes, or worth

value of formative evaluation

Helps diagnose problem areas, need for
improvement or revision
• Frequent feedback facilitates learning
• Frequent feedback allows rapid correction of
mistakes or misunderstanding
• Mastery of small units is powerful positive
reinforcement for learning and increases motivation
– this is especially true when there is a great deal to
be learned

Value of summative evaluation

A preplanned process that includes the assessment of
learner prior to further learning
• May include follow-up evaluation
• Final appraisal of results, quality, outcomes or worth
using quantitative and/or qualitative approaches

what are the 2 referenced methods for interpreting results?

1) norm-referenced

2) criterion-referenced

norm-referenced

Group provides the norm
for determining meaning of
each person’s score
• Individual compares his/her
score with the performance
of the group

example of norm-referenced

SAT or IQ test

criterion-referenced

Based on whether the learner
can perform what is stated in
the objectives
• Learners compared with a pre-
defined standard of what they
are expected to know/do – not
each other

example of criterion-referenced

Driving test or CPR certification (you pass if you meet the standard, not based on others).

_____ is key to evaluating

measuring

validity

indicates whether we are measuring what we intended to measure

reliability

refers to the consistency and accuracy with which a test or device measures something is that same way in each situation or over time

Which referenced method for interpreting results is
most appropriate with ......

• Formative evaluation techniques?
• Summative evaluation techniques?

• Formative evaluation techniques → Criterion-referenced (to check if learners meet specific objectives during learning).

• Summative evaluation techniques → Norm-referenced (often used to compare learners at the end, though criterion can also be used if tied to standards).

Which referenced method is most appropriate for different learning
domains?
• Cognitive
• Affective learning
• Psychomotor learning

• Cognitive → Both, but usually norm-referenced (tests/exams comparing knowledge).

• Affective → Criterion-referenced (measuring if attitudes/values meet objectives).

• Psychomotor → Criterion-referenced (skills measured against performance standards).