Observational methods

Observational coding

measurement of an individual's expressed feelings, speech, and behaviors made by an objective coder. 

An objective coder is

someone who doesn't know what the study hypothesis is and has no stakes in the study. 

Deductive observational coding steps:

Step 1:  Develop a theoretically grounded coding schedule 

Step 2:  Train coders and collect observational data 

Step 3:  Report on validity and reliability 

An important form of reliability for observational coding is

inter-rater reliability or observer agreement

inter-rater is…

The extent to which different observers’ judgments are associated. 

Coder Drift: 

Over time, observer’s coding can be inconsistent

Ways in which Coder drift can occur:

• Observers learn different “anchor points” for high and low levels of behaviour after more varied exposure 

• Experience increases coding ability 

• Boredom decreases coding ability 

What can help avoid coder drift?

Coding in teams can help to avoid this. 

External Validity is…

Does it associate with the things it should in the world?

The advantage of observational methods is that…

it is Naturalistic - The only way to obtain measures of people and animals as they actually live their lives Ecological validity 

Sometimes External Measurement is required

Relatively objective, reliable measurement of behavior, including of participants who cannot self-report (e.g., infants) 

An advantage of external measurement is that…

it can provide Rich Data -  Video-recorded data can be re-coded to test new theories and research questions. 

Disadvantages of this observational method is that

Time/effort

Time/money

Hawthorne effect

What is the Hawthorne effect?

when you know you are being watched your behaviour changes. It is not a demand characteristic