multiple choice testing

learning to learn

MC testing as an assessment?

easy to grade and seen as more objective (no need for a second marker)

used with large-scale standardised tests

Mc tests can be tested

MC test formats?

many different formats

most common: select single option representing the correct answer

however this doesn’t measure partial knowledge well

MC test formats that measure partial knowledge?

confidence marking

elimination testing

complete ordering

partial ordering

probability testing

what is probability testing?

final score is sum of probabilities assigned to correct answers

precision in measurement of partial knowledge

e.g. standard format: 0%- selected wrong option, probability testing: students assign higher probability to favourite option and lower to second option

correction for correct guessing?

limited number of options means that correct answers can occur without underlying knowledge

many different scoring rules have been developed to counter the effect of correct guessing

most common for a standard test: subtract partial score for each incorrect response (1/(n-1) where n= number of options). can omit answers ro avoid the penalty

what are the problems of formula scoring?

examinees don’t like being penalised

test score is influenced by metacognition: students must assess their own knowledge correctly when deciding which answers to omit

test score is influenced by risk-taking tendencies

students can omit answers that are correct- reducing their score

McDaniel et al (2007)?

web based university course on Brain and Behaviour

assigned weekly readings and then practiced with: MC quizzing, short answer quizzing, rereading

corrective feedback was provided

some facts were not practised at all

results: short-answer (cued-recall) is best. any format for retrieval practice will provide benefits

negative testing effects of MC practice tests?

people sometimes respond with an incorrect answer from practice test on cued-recall test

Marsh et al (2009)- final test?

had pps practice answering SAT II MC test questions on biology, chemistry, world history and US history

formula scored, so there was the option to omit responses

filler task then complete short-answer questions

40 items from earlier test, 40 new items

negative testing effect may overwhelm positive testing effect

corrective feedback and the negative testing effect?

Butler and Roediger (2008): negative testing effect is reduced by corrective feedback during practice

generating MC questions?

learning is boosted by both self-generating and answering questions

others can answer generated questions and reap the rewards of retrieval practice

self-generating the questions and answers yield the generation effect

PeerWise is a free online resource that can be used by students to generate their own questions and answer other student’s questions

Kelley et al (2019)?

PeerWise involves two effective learning techniques

generation: generating information leads to better memory than reading

retrieval practice: retrieving information leads to better long-term retention than restudying it