Intro to Research Methods: Scientific Method, Naturalistic Observation, Surveys, and Case Studies

Study Tools and Course Context

• Study guides are available to fill in blanks as the instructor goes through material.
• Students can email questions and answers for review; instructor does not fill in blanks for you but provides feedback.
• Study guides are useful for note-taking and as a study guide for quizzes.
• Some students don’t use the modules but still do well; others who struggle often see dramatic grade improvement when using the study guide.
• Emphasis on using study guides and modules to support preparation.
• Introduction to the quiz: the first quiz is after the holidays; the instructor emphasizes not worrying early in the semester.

What is the Scientific Method?

• Psychology is a social science; to call ourselves a science, we conform to the scientific method.
• The scientific method is the collection of solid observable data.
• Limitations: observable data must be something you can see or measure; you cannot directly observe thoughts or internal states (e.g., thinking or daydreaming).
• Data = information; ensure data are accurate and precise.
• Data sources: height, weight, and other measurable attributes are observable; other factors (like internal thoughts) require indirect inference or measurement.
• Emphasizes accuracy and precision as foundational for science; science is based on facts.
• Example: determining the height of a kindergartner involves precise measurement and instrumentation; use metric system when appropriate; ethnicity and other factors may influence averages.
• Corroboration: two different scientists (different times or methods) arriving at the same conclusion strengthens the finding. Represented as $D<em>1 ext{ corroborated by } D</em>2 o ext{fact}.$
• Analogy: precise, well-documented measurements function like a GPS in helping you locate a house; imprecise directions are less reliable.
• Gendered language and cognitive differences are introduced as a segue to later topics (e.g., hemisphere use for language). These points illustrate why precision in observation matters.
• The scientific method requires accuracy and precision, not just intuition or guesswork.

Five Steps to the Scientific Method (Overview)

• The five steps are often completed quickly and iteratively; steps 1–3 can be done in moments because humans are naturally curious.
• Step 1: Observe — notice something in the environment or within a dataset.
• Step 2: Determine the problem — articulate what happened or pose a guiding question.
• Step 3: Generate a hypothesis — an educated guess or tentative explanation (a hunch) that is testable.
• Step 4: Collect data — gather solid observable data to support or refute the hypothesis; data = information.
• Step 5: Derive a theory — an umbrella explanation that integrates results across related questions and phenomena; theories explain more than the original observation and apply more broadly.
• Note: In social science, like psychology, you may revise hypotheses or repeat steps based on what the data reveal; the path is not always a straight line from 1 through 5.
• In-class example used to illustrate the process: observe a cop stopping cars, hypothesize about color effects, and design an experiment with controlled variables.

Step-by-Step Example: Color and Shape in Speed-Ticket Hypotheses

• Observation: When driving, cops stop red cars more than other colors (a common classroom observation).
• Step 2 (Problem): Why do cops stop red cars more often? Is color causing more tickets, or might there be another factor?
• Step 3 (Hypotheses):
  • H1: Color drives ticket frequency (red cars get more tickets due to attention-capture).
  • H2 (alternative angle): Shape of the car might influence ticket frequency (e.g., sportier shapes attract more speeding).
• Step 4 (Data collection plan): A two-week field study with a single driver on a straight stretch (Route 1) with 10 cars total per color and per shape across days. Colors tested: silver, blue, red, green, black; Shapes tested: red Volkswagen Beetle, sedan, Lamborghini, SUV, minivan; Same driver used to control driver-related variation; Time window: 09:30–10:30.
• Step 5 (Theory): Both color and shape may influence ticket likelihood; results may indicate multiple contributing factors (color psychology and shape aesthetics).
• Practical takeaway: Color psychology can be a topic for presentations; color and contextual cues influence perception and behavior (e.g., red signaling danger).

Color Psychology Highlights and Applications

• Color effects explained: red tends to evoke arousal and danger cues; orange and yellow in fast-food interiors can increase appetite; green packaging in groceries is associated with natural/organic products; white is associated with cleanliness (hospitals).
• Cultural differences: color meanings vary across societies (e.g., black mourning in America vs white mourning in China).
• Practical presentation suggestion: Color psychology is a compelling, approachable topic for short student presentations (around 5 minutes).
• The instructor notes that color psychology is a recurring theme for the semester and ties into broader methodological discussions.

Quiz Structure and Preparations

• The scientific method is not on quiz material for this class; there will be an emphasis on study guides and the study guide content for preparation.
• Quizzes 2–5 are multiple choice; Quiz 1 is an essay on research methods.
• There are 10 points of extra credit built into the first five quizzes; total extra credit plan is substantial (up to 80 extra credit points across the course). The extra credit components include naturalistic observation, surveys, and case studies, each worth 10 points.
• Quizzes are noncumulative; you may skip Quiz 1 makeup unless you miss the scheduled quiz, in which case a makeup option exists with documentation.
• Canvas announcements will communicate extra-credit opportunities and rubrics; instructors may post guidance about papers and grading.
• For the essay, the instructor will specify the area of focus (one of the five research methods) and provide an example when all five topics are covered.

Research Methods: Naturalistic Observation

• Definition: Observing people or animals in their natural settings without interference.
• Pros: Real-life data; captures behavior in natural contexts (e.g., how polar bears behave in the Arctic, how third-graders behave a week before Valentine’s Day).
• Cons (major negatives):
  • Observer effect: presence of observer alters behavior (e.g., people slow down when they see a cop or act differently when they know they are being watched).
  • Observer bias: preconceptions influence what the observer records; documentation may reflect expectations rather than reality.
  • No control: you cannot manipulate conditions or ensure random assignment; events may be slow or unpredictable (e.g., waiting for a polar bear to do something).
  • Time consumption: waiting for events; may be boring or inefficient.
• Mitigation strategies: use hidden cameras or two-way mirrors to reduce observer effect, with appropriate permissions.
• Note-taking tips: use abbreviations, arrows for comparison (↑ means greater than, ↓ means less than), and three dots to mean therefore; circle important observations; keep notes personal to aid memory.

Naturalistic Observation Examples and Ethical Considerations

• Orangutan medicinal leaves case: a female orangutan uses leaves to treat an injured arm; after several days, the arm heals; subsequent observation leads to pharmaceutical discovery; illustrates how naturalistic observation can yield important findings but requires careful interpretation and respect for animal welfare.
• Australian pack rat mine-sniffing example: a rat excels at detecting mines due to specialized senses; potential for military and safety applications; demonstrates cross-species utility of observational data.
• Dogs sniffing cancer and pregnancy cues: dogs’ sensory abilities reveal information humans cannot easily detect; anthropomorphic comparisons highlighted for interest.
• Pregnancy detection and human odors: hormonal changes can create detectable scents for animals, though not reliably for humans.
• Humor and caution: social commentary about modern culture (e.g., fashion, cleanliness, and beliefs about everyday life) used to illustrate how preconceptions can shape observations; warning against letting biases color data.
• Ethical caveats: observers cannot communicate with subjects in order to avoid influencing behavior; avoidance of “stalking” or intrusive behavior in naturalistic studies; privacy and consent considerations are essential in real-world research planning.
• The ethics of observation underscore the importance of documenting what actually happens rather than what investigators expect to happen.

Observer Bias and Preconceptions

• Preexisting ideas can color what the observer notes; example: expecting certain gender-based patterns in preschool classrooms can bias recording of behavior.
• Open-minded observation is encouraged to capture genuine behavior rather than confirming stereotypes.
• Emphasis on avoiding labeling and ensuring cultural sensitivity when describing behaviors across groups.
• Real-world anecdote about ethical observational practice using nature documentaries and field observations to illustrate good and bad practices in data collection.

Practical Aspects of Naturalistic Observation Assignments

• Cultural diversity component: all three papers (naturalistic observation, survey, case study) include a cultural diversity element.
• Naturalistic Observation one-page paper: describe an observation in a setting unfamiliar to the student (e.g., a restaurant with unfamiliar cuisine or a different grocery store); include raw data, a short summary, and evidence of site visit (e.g., menu photo or receipt). The student should compare and contrast observations with typical experiences.
• Example assignment prompts: visit a different restaurant, compare with a familiar one; visit a grocery store with a different cultural orientation; observe sounds, smells, labels, and the layout.
• Evidence: attach photos, menus, or other artifacts to the paper.
• Instructor emphasizes checking with the instructor before beginning a culturally sensitive observation to avoid missteps that could yield zero points.

Case Studies vs Naturalistic Observation vs Surveys

• Case study definition: deep examination of one person, one family, or one institution; highly detailed but not generalizable to the broader population.
• Case study example: a student interviews a family member or an elderly relative; caution against choosing a non-cultural single subject (e.g., a pet) for cultural comparisons.
• Lessons from case studies: the single-subject approach can reveal unique insights but cannot justify broad generalizations about all people.
• The instructor encourages emailing with ideas prior to conducting a case study to ensure alignment with course goals and cultural relevance.

Surveys: Types, Ethics, and Best Practices

• Survey types: online (e.g., SurveyMonkey), pencil-and-paper, in-person interviews, and telephone interviews.
• Anonymity: surveys should be anonymous; do not include identifying information; avoid requesting personal data that could compromise privacy.
• Demographics: include gender, age bracket, and income where appropriate to understand how responses may differ across groups.
• Survey design: keep to 10 questions for the extra-credit survey; use yes/no questions to simplify responses; ensure 10 culturally diverse respondents.
• Sample size rationale: the instructor uses a small, culturally diverse sample (10 people) for extra credit to illustrate methodology rather than to produce generalizable results.
• Data handling: the respondent’s answers are anonymized; data should be stored securely; avoid linking responses to individuals.
• Common pitfalls: social desirability and dishonest answers when anonymity is not protected; misinterpretations of statistics and misreporting in popular media (e.g., magazine surveys).
• Example: Cosmo sex survey illustrates how sensational statistics can misrepresent reality; a single statistic can mislead readers if the underlying sample is unrepresentative.
• Misleading statistics example: Harvard ten-year study misinterpreted a statistic about women in the workforce; the sensational claim about terrorists and marriage was not representative of the broader population and illustrated how numbers can be distorted in media reporting.
• Practical insights: always consider sampling bias, sample size, and the representativeness of respondents when interpreting survey results.

Case Study: Interview-Based Research and Cultural Focus

• Case studies involve interviewing one person or a small group; it provides depth but not generalizability.
• Example pitfalls: interviewing a grandparent for a cross-cultural comparison can yield meaningful insights; interviewing a pet does not provide cross-cultural data and may fail to meet assignment requirements.
• Ethical communications: students should seek instructor feedback before pursuing a case study idea to avoid wasting time and to ensure alignment with course objectives.

Correlation and Experiments: Preview for Next Session

• The instructor previews correlation and experiments as topics for the next class, noting that these are more involved and will require more preparation.
• This sets up expectations for Thursday’s discussion and exercises related to the core two major methods of data collection in psychology.

Quick Reference: Key Formulas and Notations

• Steps of the scientific method: let S=igl brace S1, S2, S3, S4, S_5 igr brace with
  • $S_1= ext{Observe},$
  • $S_2= ext{Determine problem (question)},$
  • $S_3= ext{Hypothesis},$
  • $S_4= ext{Collect data},$
  • $S_5= ext{Derive theory}.$
• Corroboration concept: data $D<em>1, D</em>2$ verified by independent researchers increases confidence in a finding (i.e., corroboration).
• In the color-vehicle experiment design: color set $C={silver, blue, red, green, black}$; shape set P=\{Beetle, sedan, Lamborghini, SUV, minivan}. The dependent variable is tickets issued, denoted as $T.$ Two-week design: Week 1 tests color; Week 2 tests shape; same driver controls extraneous variance.
• Demographics in surveys: {
  • Gender (M/F),
  • Age bracket,
  • Income level
    } for analysis of response differences.
• Extra-credit allocation: each of the three assignments (naturalistic observation, survey, case study) = $10 ext{ points}$; total potential extra credit = $80 ext{ points}$ across the course.

Closing Notes for Exam Preparation

• Remember: the scientific method emphasizes observable data, accuracy, precision, and the iterative nature of hypotheses and data collection.
• Naturalistic observation offers real-world data but comes with challenges like observer effects, bias, lack of control, and time requirements.
• Surveys require careful attention to anonymity, demographics, and question design to avoid bias and misinterpretation.
• Case studies provide depth but limit generalizability; always consider how findings translate to broader populations.
• Be prepared for correlations and experiments in upcoming sessions; these are more complex and require understanding of study design, control of confounds, and interpretation of results.

Suggested Focus for Studying

• Differences between observation, hypothesis formation, data collection, and theory development.
• How to minimize observer effects and observer bias in naturalistic observation.
• The importance of anonymity and demographics in survey design.
• Ethical considerations and feasibility of different research methods.
• How color psychology can influence behavior and how cultural differences alter color meanings.
• The structure of quizzes and the role of extra credit in the course.