CHAPTER 3: ALTERNATIVES TO EXPERIMENTATION: NONEXPERIMENTAL DESIGNS |
Nonexperimental approaches - do not create levels of an independent variable nor randomly assign
subjects to these levels.
- used where experiments are not ethical or possible, or where we want to test hypotheses in realistic conditions; used to study behaviors in natural settings to explore unique or rare occurrences.
Internal validity - the degree to which a researcher can establish a causal relationship between the independent and dependent variables.
- an internally valid experiment allows us to draw cause-and-effect conclusions.
➔ An experiment has high internal validity when we can demonstrate that only the antecedent conditions are responsible for group differences in behavior.
➔ Laboratory experiments are often higher in internal validity because of their control of extraneous variables.
● Researchers create levels of the IV and use procedures like matching and random assignment to conditions.
External validity - the degree to which research findings can be generalized to other settings and individuals.
➔ Nonexperimental studies achieve higher external validity because they are more frequently conducted in real-world settings with a more diverse sample of participants than experiments.
➔ What we gain in external validity we might lose in internal validity.
All approaches to research can be described along two major dimensions:
1. Degree of manipulation of antecedent conditions - concerns assignment of subjects to
antecedent conditions created for the experiment.
➔ degree of manipulation in the treatments (IV) given; In the case of Nonexperimental designs, this is low.
➔ theoretically varies from low to high (from letting things happen as they will to setting up carefully controlled conditions).
2. Degree of imposition of units - how much you limit a subject’s responses on the DV.
➔ Example: gathering data on teenage behavior (low imposition of units) versus gathering data on the music preferences of teenagers: e.g. “How often do you listen to hip-hop?” (high imposition of units).
Phenomenology |
- involves a subject's description of personal subjective experience; Private Personal experience is the source of data
- low in manipulation of antecedent conditions and low in imposition of units (low-low).
- describes but cannot explain behavior
- these days, it is seldom, if ever, used as a research method on its own; its elements are most often combined with other research methods.
CASE STUDIES |
- a researcher compiles a descriptive study of a subject's experiences, observable behaviors, and archival records kept by an outside observer; heavily used in Forensic, Organizational, and Clinical psychology
- range from low-low (low manipulation of antecedent conditions and low imposition of units) to low-high
Advantages | Limitations |
★ source of inferences, hypotheses, and theories ★ source of developing therapy techniques ★ allow the study of rare phenomena ★ provide exceptions to accepted ideas, theories, and practices ★ persuasive and motivational value (advertising) | ★ representativeness of sample ★ completeness of data ★ reliance on retrospective data |
Retrospective data - recollections of past events that are collected in the present.
➔ Example: childhood memories constitute retrospective data, but your undergraduate portfolio does not since it was collected in the past.
- information may be compromised by faulty memory, current mood, and the retrieval cues that are present when you are asked to recall an event.
FIELD STUDIES |
Field Studies | ➔ These are non-experimental studies conducted in the field (real-life settings) ➔ The experimenter does not manipulate antecedent conditions ➔ Field studies range from low-low to low-high |
Naturalistic Observation | ➔ Examines subjects’ spontaneous behavior in their actual environments and may obtain more representative behavior than experiments ➔ This method can achieve high levels of external validity |
★ In field studies, the problem of reactivity can happen. This is when subjects alter their behavior when they know that they are being observed
○ Your baby sister stops saying “Gramma” when you place the home near her mouth
Participant-Observer Study | ➔ This involves field observation in which the researcher is part of the studied group ➔ It is in contrast with naturalistic observation, where the researcher does not interact with research subjects to avoid reactivity
(Main) Ethical Problems That Complicate Participant-Observer Studies: ➢ Invasion of privacy ➢ Not telling people that you are studying their behavior ➢ Pretending to be a group member (requires careful planning since this is a serious problem) |
Difference of Field Experiments with Field Studies
1. Field Experiments - these are experiments conducted in a real-life setting
2. Field Studies - these are non-experimental designs used in real-life settings and include naturalistic observation, unobtrusive measures, participant-observer studies, and surveys
Archival Study | ➔ It is a descriptive method where researchers re-examine data that were collected for other purposes ◆ Universities collect a wealth of data through surveys like the Graduating Senior Questionnaire (GSQ) and interviews |
QUALITATIVE RESEARCH |
Qualitative Research | ➔ This type of research obtains data consisting of words instead of numbers ➔ The information is obtained through: ◆ Self-reports ◆ Personal narratives ◆ Expression of ideas ◆ Memories ◆ Feelings ◆ Thoughts |
● Paradigm Shift - a change in attitudes, values, beliefs, methods, and procedures accepted during a specific time period. This represents the increased use of qualitative research
● Qualitative research is invaluable in studying contextual phenomena behavior that can only be understood within its context
○ We might examine the meaning of religious faith for patients facing impending surgery
INFORMATION SOURCES EMPIRICAL PHENOMENOLOGY USE |
Empirical phenomenology might rely on an experimenter’s private experiences or other experiential data:
1. The researcher’s self-reflection on relevant experiences
2. Participants’ oral or written descriptions of their experiences
3. Accounts from literature, poetry, visual art, television, theatre, and phenomenological (and other) research
CHAPTER 4: ALTERNATIVES TO EXPERIMENTATION: SURVEYS AND INTERVIEWS |
SURVEY RESEARCH |
Survey Research | ➔ Obtains data about opinions, attitudes, preferences, and behaviors using questionnaires or interviews. ➔ It allows researchers to study private experiences, which cannot be directly observed. |
ADVANTAGES OF SURVEY APPROACH |
● We can efficiently collect large amounts of data.
● Anonymous surveys can increase the accuracy of answers to sensitive questions.
● Surveys can allow us to draw inferences about the causes of behavior and can complement laboratory and field experiments.
● The survey approach does not allow us to test hypotheses about causal relationships because we do not manipulate independent variables and control extraneous variables; this is the important limitation of the survey approach
MAJOR STEPS IN CONSTRUCTING SURVEYS |
1. Identify specific research objectives
2. Decide on the degree of imposition of units (Degree of response restriction: free or restricted?)
3. Decide how you will analyze the survey data
CONSTRUCTING SURVEYS |
MAJOR QUESTION TYPES |
Closed Question or Structured Questions | ➔ Questions that can be answered using a limited number of alternatives and have a high imposition of units ◆ “How many songs did your roommate illegally download this month?” |
Open-ended Questions or Open Questions | ➔ Questions that require participants to respond with more than a yes or 1-10 rating and have a low imposition of units ◆ “Why did you choose your major?” |
How do researchers analyze data from each question type? ★ The number or percent of responses can be reported for closed questions. ★ Open-ended questions can be analyzed using content analysis, like Yepez’s INTERSECT, in which responses are assigned to categories using objective rules. |
THREE CONCERNS WHEN CONSTRUCTING QUESTIONS |
1. Keep items simple and unambiguous and avoid double negatives
2. Avoid double-barreled (compound) questions that require responses about two or more unrelated ideas
3. Use exhaustive response choices
MEASURING RESPONSES |
Nominal Scale | ➔ Assigns items to two or more distinct categories that can be named using a shared feature but do not measure their magnitude ◆ Sorting professors into exciting and dull categories |
Ordinal Scale | ➔ Measures the magnitude of the dependent variable using ranks but does not assign precise values ◆ Marathon contestants may finish from first place to last place |
Interval Scale | ➔ Measures the magnitude of the DV using equal intervals between values with no absolute zero point ◆ Fahrenheit or Centigrade temperatures, and Sarnoff and Simbardo’s (1961) 0-100 scale |
Ratio Scale | ➔ Measures the magnitude of the DV using equal intervals between values and an absolute zero ➔ It allows us to state that a 2-meter board is twice as long as a 1-meter board ◆ Distance in meters |
● In selecting the appropriate measurement scale to utilize in a study: the best type of scale depends on the variable you are studying and the level of precision you desire
○ Psychological variables like traits, attitudes, and preferences, represent a continuous dimension, and several levels of measurement “fit” equally well
○ When working with variables like sociability, psychologists often select the highest scale since it provides more information and allows analysis using more powerful statistics
IMPORTANT CONSIDERATIONS FOR SURVEY ITEMS |
➔ Subjects decide to refuse to answer surveys during the start or first few questions.
➔ Engage subjects from the start by asking interesting questions they will not mind answering.
➔ The first survey question should be:
1. Relevant to the survey’s central topic
2. Easy to answer
3. Interesting
4. Answerable by most respondents
5. Closed format
➔ Whenever possible, use commonly used response options.
➔ Avoid value-laden questions that might make a response seem embarrassing.
◆ Version 1: Do you believe doctor should be allowed to kill unborn babies during the first trimester of pregnancy
◆ Version 2: do you believe doctors should be allowed to terminate a pregnancy during the first trimester?
Response Style | ➔ These are tendencies to respond to questions or items without regard to their actual wording. ➔ People differ in their willingness to answer, position preference, and yea-saying and nay-saying. ➔ Willingness to answer is the tendency to guess or omit items when unsure
Position Preference Response Style is selecting an answer based on its position; students choosing “c” on multiple-choice exams because it somehow represents being ‘in-between’ |
Manifest Content | ➔ The plain meaning of the words printed on the page ➔ While we expect subjects to respond to the manifest content of questionnaires, they may
Yes-saying is agreeing with an item regardless of its manifest content
Nay-saying is disagreeing with an item regardless of its manifest content |
Context Effects | ➔ These are changes in question interpretation due to their position within a survey ➔ It is a problem especially likely when two questions are related and not separated by buffer items (unrelated questions) |
COLLECTING SURVEY DATA |
Social Desirability Response Set | ➔ It is a response set that represents ourselves in a socially appropriate fashion when responding to a question’s latent content (underlying meaning) ◆ Dressing formally for a job interview instead of wearing your favorite jeans |
Structured Interviews | ➔ Questions are asked the same way each time ➔ It provides more usable, quantifiable data |
Unstructured Interviews | ➔ The interviewer can explore interesting topics as they arise ➔ These data may not be usable for content analysis |
SAMPLING |
Population | ➔ It consists of all people, animals, or objects that share at least one characteristic |
Sample | ➔ Is a subset of the population of interest - the population we are studying |
PROBABILITY SAMPLING |
Two Advantages of Probability Sampling (over nonprobability sampling):
1. A probability sample is more likely to represent the population (external validity) than a nonprobability sample.
2. We know the exact odds of members of the population being included in our sample. This tells us whom the sample represents.
FOUR MAIN PROBABILITY SAMPLING METHODS |
1. Simple Random Sampling
2. Systematic Random Sampling
3. Stratified Random Sampling
4. Cluster Sampling
FOUR MAIN NON-PROBABILITY SAMPLING METHODS |
1. Quota Sampling
2. Convenience Sampling
3. Purposive Sampling
4. Snowball Sampling