Pilot study, reliability and validity terms, implications on economy & peer review

Pilot studies (5 points)

-small scale practice investigations

-prior to research

-identify potential problems

-Ps may suggest changes, e.g. when there is DCs

-to see whether significant results may be found

What is test-retest reliability?

Where the same test is administered twice over a period of time to a group of individuals. The correlation coefficient between the two sets of scores can then act as a measure of test-retest reliability.

What is split-half reliability?

Where a test is split into two halves (e.g. one half odd numbered questions, one half even). Test should have a large number of questions, measuring same knowledge area. Each half is administered to the same person, then the correlation between the scores for both halves is calculated.

What does a higher correlation in split-half reliability indicate?

Higher internal consistency, and that all parts of the test are contributing fairly equally to what is being measured.

Two examples of psychological research affecting the economy

-Role of father

-Research supporting treatment of mental disorders

Main aims of peer review

-to allocate research funding

-to validate quality and relevance of research

-to suggest amendments or improvements

Peer review eval points

-publication bias - want to publish headline-grabbing

-Burying groundbreaking research if it contradicts their own view

-peers may use anonymity to criticise research

What is construct validity?

A measure of how well a test is measuring the theory it is based on

What is criterion validity?

The extent to which a test measures the outcome it was designed to measure

How is criterion validity measured?

-by statistically testing a new measurement technique against an independent criterion to establish concurrent validity

-by statistically testing against a future performance to establish predictive validity