Experimental Psychology Chapter 3 & 4

CHAPTER 3: ALTERNATIVES TO EXPERIMENTATION: NONEXPERIMENTAL DESIGNS

 

Nonexperimental approaches - do not create levels of an independent variable nor randomly assign

subjects to these levels.

-         used where experiments are not ethical or possible, or where we want to test hypotheses in realistic conditions; used to study behaviors in natural settings to explore unique or rare occurrences.

 

Internal validity - the degree to which a researcher can establish a causal relationship between the independent and dependent variables.

-         an internally valid experiment allows us to draw cause-and-effect conclusions.

     An experiment has high internal validity when we can demonstrate that only the antecedent conditions are responsible for group differences in behavior.

     Laboratory experiments are often higher in internal validity because of their control of extraneous variables.

 

       Researchers create levels of the IV and use procedures like matching and random assignment to conditions.

 

External validity - the degree to which research findings can be generalized to other settings and individuals.

     Nonexperimental studies achieve higher external validity because they are more frequently conducted in real-world settings with a more diverse sample of participants than experiments.

     What we gain in external validity we might lose in internal validity.

 

All approaches to research can be described along two major dimensions:

1.      Degree of manipulation of antecedent conditions - concerns assignment of subjects to

antecedent conditions created for the experiment.

     degree of manipulation in the treatments (IV) given; In the case of Nonexperimental designs, this is low.

     theoretically varies from low to high (from letting things happen as they will to setting up carefully controlled conditions).

2.      Degree of imposition of units - how much you limit a subject’s responses on the DV.

     Example: gathering data on teenage behavior (low imposition of units) versus gathering data on the music preferences of teenagers: e.g. “How often do you listen to hip-hop?” (high imposition of units).

 

Phenomenology

 

-         involves a subject's description of personal subjective experience; Private Personal experience is the source of data

-         low in manipulation of antecedent conditions and low in imposition of units (low-low).

-         describes but cannot explain behavior

-         these days, it is seldom, if ever, used as a research method on its own; its elements are most often combined with other research methods.

 

CASE STUDIES

 

-         a researcher compiles a descriptive study of a subject's experiences, observable behaviors, and archival records kept by an outside observer; heavily used in Forensic, Organizational, and Clinical psychology

-         range from low-low (low manipulation of antecedent conditions and low imposition of units) to low-high

 

Advantages

Limitations

      source of inferences, hypotheses, and theories

      source of developing therapy techniques

      allow the study of rare phenomena

      provide exceptions to accepted ideas, theories, and practices

      persuasive and motivational value (advertising)

      representativeness of sample

      completeness of data

      reliance on retrospective data

 

Retrospective data - recollections of past events that are collected in the present.

     Example: childhood memories constitute retrospective data, but your undergraduate portfolio does not since it was collected in the past.

-         information may be compromised by faulty memory, current mood, and the retrieval cues that are present when you are asked to recall an event.

 

FIELD STUDIES

 

Field Studies

     These are non-experimental studies conducted in the field (real-life settings)

     The experimenter does not manipulate antecedent conditions

     Field studies range from low-low to low-high

 

Naturalistic Observation

     Examines subjects’ spontaneous behavior in their actual environments and may obtain more representative behavior than experiments

     This method can achieve high levels of external validity

 

      In field studies, the problem of reactivity can happen. This is when subjects alter their behavior when they know that they are being observed

       Your baby sister stops saying “Gramma” when you place the home near her mouth

 

Participant-Observer Study

     This involves field observation in which the researcher is part of the studied group

     It is in contrast with naturalistic observation, where the researcher does not interact with research subjects to avoid reactivity

 

(Main) Ethical Problems That Complicate Participant-Observer Studies:

     Invasion of privacy

     Not telling people that you are studying their behavior

     Pretending to be a group member (requires careful planning since this is a serious problem)

 

Difference of Field Experiments with Field Studies

1.       Field Experiments - these are experiments conducted in a real-life setting

2.       Field Studies - these are non-experimental designs used in real-life settings and include naturalistic observation, unobtrusive measures, participant-observer studies, and surveys

 

Archival Study

     It is a descriptive method where researchers re-examine data that were collected for other purposes

      Universities collect a wealth of data through surveys like the Graduating Senior Questionnaire (GSQ) and interviews

 

QUALITATIVE RESEARCH

 

Qualitative Research

     This type of research obtains data consisting of words instead of numbers

     The information is obtained through:

      Self-reports

      Personal narratives

      Expression of ideas

      Memories

      Feelings

      Thoughts

 

       Paradigm Shift - a change in attitudes, values, beliefs, methods, and procedures accepted during a specific time period. This represents the increased use of qualitative research

       Qualitative research is invaluable in studying contextual phenomena behavior that can only be understood within its context

       We might examine the meaning of religious faith for patients facing impending surgery

 

INFORMATION SOURCES EMPIRICAL PHENOMENOLOGY USE

 

Empirical phenomenology might rely on an experimenter’s private experiences or other experiential data:

1.      The researcher’s self-reflection on relevant experiences

2.      Participants’ oral or written descriptions of their experiences

3.      Accounts from literature, poetry, visual art, television, theatre, and phenomenological (and other) research

 

CHAPTER 4: ALTERNATIVES TO EXPERIMENTATION: SURVEYS AND INTERVIEWS

 

SURVEY RESEARCH

 

Survey Research

     Obtains data about opinions, attitudes, preferences, and behaviors using questionnaires or interviews.

     It allows researchers to study private experiences, which cannot be directly observed.

 

ADVANTAGES OF SURVEY APPROACH

 

       We can efficiently collect large amounts of data.

       Anonymous surveys can increase the accuracy of answers to sensitive questions.

       Surveys can allow us to draw inferences about the causes of behavior and can complement laboratory and field experiments.

       The survey approach does not allow us to test hypotheses about causal relationships because we do not manipulate independent variables and control extraneous variables; this is the important limitation of the survey approach

 

MAJOR STEPS IN CONSTRUCTING SURVEYS

 

1.      Identify specific research objectives

2.      Decide on the degree of imposition of units (Degree of response restriction: free or restricted?)

3.      Decide how you will analyze the survey data

 

CONSTRUCTING SURVEYS

 

MAJOR QUESTION TYPES

 

Closed Question or Structured Questions

     Questions that can be answered using a limited number of alternatives and have a high imposition of units

      “How many songs did your roommate illegally download this month?”

Open-ended Questions or Open Questions

     Questions that require participants to respond with more than a yes or 1-10 rating and have a low imposition of units

      “Why did you choose your major?”

How do researchers analyze data from each question type?

      The number or percent of responses can be reported for closed questions.

      Open-ended questions can be analyzed using content analysis, like Yepez’s INTERSECT, in which responses are assigned to categories using objective rules.

 

 

 

 

THREE CONCERNS WHEN CONSTRUCTING QUESTIONS

 

1.      Keep items simple and unambiguous and avoid double negatives

2.      Avoid double-barreled (compound) questions that require responses about two or more unrelated ideas

3.      Use exhaustive response choices

 

MEASURING RESPONSES

 

Nominal Scale

     Assigns items to two or more distinct categories that can be named using a shared feature but do not measure their magnitude

      Sorting professors into exciting and dull categories

Ordinal Scale

     Measures the magnitude of the dependent variable using ranks but does not assign precise values

      Marathon contestants may finish from first place to last place

Interval Scale

     Measures the magnitude of the DV using equal intervals between values with no absolute zero point

      Fahrenheit or Centigrade temperatures, and Sarnoff and Simbardo’s (1961) 0-100 scale

Ratio Scale

     Measures the magnitude of the DV using equal intervals between values and an absolute zero

     It allows us to state that a 2-meter board is twice as long as a 1-meter board

      Distance in meters

 

       In selecting the appropriate measurement scale to utilize in a study: the best type of scale depends on the variable you are studying and the level of precision you desire

       Psychological variables like traits, attitudes, and preferences, represent a continuous dimension, and several levels of measurement “fit” equally well

       When working with variables like sociability, psychologists often select the highest scale since it provides more information and allows analysis using more powerful statistics

 

IMPORTANT CONSIDERATIONS FOR SURVEY ITEMS

 

     Subjects decide to refuse to answer surveys during the start or first few questions.

     Engage subjects from the start by asking interesting questions they will not mind answering.

     The first survey question should be:

1.      Relevant to the survey’s central topic

2.      Easy to answer

3.      Interesting

4.      Answerable by most respondents

5.      Closed format

     Whenever possible, use commonly used response options.

     Avoid value-laden questions that might make a response seem embarrassing.

      Version 1: Do you believe doctor should be allowed to kill unborn babies during the first trimester of pregnancy

      Version 2: do you believe doctors should be allowed to terminate a pregnancy during the first trimester?

 

Response Style

     These are tendencies to respond to questions or items without regard to their actual wording.

     People differ in their willingness to answer, position preference, and yea-saying and nay-saying.

     Willingness to answer is the tendency to guess or omit items when unsure

 

Position Preference Response Style is selecting an answer based on its position; students choosing “c” on multiple-choice exams because it somehow represents being ‘in-between’

 

Manifest Content

     The plain meaning of the words printed on the page

     While we expect subjects to respond to the manifest content of questionnaires, they may
ignore it when answering questions about their feelings or attitudes.

 

Yes-saying is agreeing with an item regardless of its manifest content

 

Nay-saying is disagreeing with an item regardless of its manifest content

 

Context Effects

     These are changes in question interpretation due to their position within a survey

     It is a problem especially likely when two questions are related and not separated by buffer items (unrelated questions)

 

COLLECTING SURVEY DATA

 

Social Desirability Response Set

     It is a response set that represents ourselves in a socially appropriate fashion when responding to a question’s latent content (underlying meaning)

      Dressing formally for a job interview instead of wearing your favorite jeans

 

Structured Interviews

     Questions are asked the same way each time

     It provides more usable, quantifiable data

Unstructured Interviews

     The interviewer can explore interesting topics as they arise

     These data may not be usable for content analysis

 

SAMPLING

 

Population

     It consists of all people, animals, or objects that share at least one characteristic

Sample

     Is a subset of the population of interest - the population we are studying

 

PROBABILITY SAMPLING

 

Two Advantages of Probability Sampling (over nonprobability sampling):

1.      A probability sample is more likely to represent the population (external validity) than a nonprobability sample.

2.      We know the exact odds of members of the population being included in our sample. This tells us whom the sample represents.

 

FOUR MAIN PROBABILITY SAMPLING METHODS

 

1.      Simple Random Sampling

2.      Systematic Random Sampling

3.      Stratified Random Sampling

4.      Cluster Sampling

 

FOUR MAIN NON-PROBABILITY SAMPLING METHODS

 

1.      Quota Sampling

2.      Convenience Sampling

3.      Purposive Sampling

4.      Snowball Sampling

robot