reliability + evaluation

reliability onwards

What is external reliability?

the extent to which a test produces consistent results over several occasions on the same participant

Internal reliability

the extent to which a test or measure is consistent within itself

inter-rater reliability

where two or more psychologists produce consistent results whilst observing the same behaviour, seen through a positive correlation of their data

test re-test reliability

involves testing and retesting the same participants over time, with the same test, and comparing their scores. if the scores are the same the test has external reliability

split-path reliability

involves splitting a participants test answers in half and seeing whether they got the same or similar scores on the two halves. if so, internal reliability is high

how to assess for internal reliability

split half reliability

how to assess for external reliability

test re-test reliability

how to deal with issues of INTERNAL reliability

redesign individual questions

how to deal with issues of EXTERNAL reliability

redesign individual questions, train the interviewer

how to deal with issues of inter-rater reliability?

coding system (operationalise), standardised procedure (train), pilot study (trial run)

what are the 3 issues of reliability?

is the procedure standardised? is the measuring tool accurate? did they operationalise the variables?

what are the 3 WAYS OF DEALING WITH issues of reliability?

standardise procedure, standardise instructions, standardise environment

what should we look for when trying to identify issues of reliability?

threats to consistency

what should we look to do when dealing with issues of reliability?

make it standardised/consistent