Psychological Research Methods, Scientific Inquiry, and Historical Foundations

Evaluative Thinking and Healthy Skepticism in Psychology

  • Case Scenario Analysis: Notifications and Academic Performance

    • Headline Example: "Study says notifications are hurting your grades."
    • Scenario Context: A student studying for a quiz experiences a phone light-up, reads one notification, and remains distracted holding the phone five minutes later.
    • Potential Analytical Conclusions:
    • Conclusion A: Notifications caused the lower quiz scores.
    • Conclusion B: Notifications and quiz scores were related to one another.
    • Conclusion C: Students with fewer notifications definitely learned more.
    • Evaluation of Conclusions:
    • Conclusion B is the most scientifically accurate interpretation because it identifies an existing relationship without making unverified causal claims.
    • Conclusion A cannot be stated definitively due to unmeasured confounding variables, such as whether the student only slept for 2 m/s22\,m/s^2 or 2 hours2\,\text{hours} the previous night or whether the student studied for the exam at all.
    • Conclusion C cannot be definitively stated because learning gain cannot be confirmed solely from notification counts.

  • Concept and Practice of Healthy Skepticism

    • Definition: Healthy skepticism does not mean assuming everyone is lying, which would be exhausting on a daily basis. Instead, it is defined by the principle of demanding evidence: "Show me how you know that."
    • Four Critical Questions for Evaluating Claims:
    • Question 1: Who is making the claim, and what is their expertise?
      • Assess credentials, specialized information, and relevant experience.
      • Caveat on Experience: Having 10 years10\,\text{years} of experience in a broken system does not constitute mastery; it merely represents repeated execution without structural correction.
    • Question 2: What do they gain if the claim is believed?
      • Examine financial incentives, corporate sponsorships, and pressures to rush research for paychecks.
      • Historical Example: Dietary guidelines transitioned from the Food Pyramid to the Food Plate (and back). Documentaries revealed that health researchers establishing the Food Pyramid were sponsored by food corporations such as Kellogg's, KFC, and McDonald's.
    • Question 3: Does the evidence match the size of the claim?
      • Evaluate sample size and generalizability.
      • Small Sample Example: A sample of 40 students40\,\text{students} in a single classroom can provide an initial indication, but it cannot represent every student in America or the world.
      • Infrastructure Survey Example: Clarksville survey regarding an extension to Highway I-24 reported that 80%80\% of residents supported the extension. Deep analysis revealed that only 100 people100\,\text{people} filled out the survey out of a total population of 200,000 residents200{,}000\,\text{residents}. Among those 100 respondents100\,\text{respondents}, 80 people80\,\text{people} voted yes and 20 people20\,\text{people} voted no. Thus, an 80%80\% approval rate from 100 sample units100\,\text{sample units} is not a reliable indicator for 200,000 citizens200{,}000\,\text{citizens}.
    • Question 4: What does the rest of the research say?
      • Research must be analyzed holistically, paying close attention to limitations and recommendations for future research. Limitations can make or break a study's validity.
    • Peer Review and Replication Steps:
    • Peer Review: Scholars within the same or similar field review research designs and findings to identify gaps and poke holes in methodology.
    • Replication: A study's procedures must allow independent researchers to follow the exact steps and achieve identical results. Unrepeatable studies represent mere coincidence.

The Scientific Loop, Theories, Hypotheses, and Reasoning

  • The Scientific Method Loop

    • Idea, Interpretation, and Hypothesis Steps (Steps 1, 2, and 3): Formulating an initial idea (e.g., observing a roommate leaving unwashed dishes in the sink), interpreting the problem, connecting it to a hypothesis, and contextualizing it within a broader theory.
    • Testing Step (Step 4): Conducting the experiment or research methodology.
    • Revision, Publication, and Replication Steps (Steps 5 and 6):
    • Step 5: Publishing and sharing research for peer review.
    • Step 6: Replicating the exact study procedures.

  • Theory versus Everyday Guesswork

    • Colloquial Definition: In casual speech, a theory implies a mere guess or random thought.
    • Scientific Definition: A theory is a broad, well-developed explanation that connects numerous tested observations and predictions.
    • Metaphor: A theory functions like a neighborhood, whereas individual hypotheses represent specific houses or streets within that neighborhood.
    • Specific Hypotheses Nested Under Distraction Theory:
    • Task switching triggered by clicking a notification.
    • Background talking or audio/video distractions.
    • Pop-up alerts: Distinguish between routine text/email notifications and high-intensity pop-up alerts like Amber Alerts, which are loud, startling, and impair the ability to regain study focus.

  • Formulating and Falsifying Hypotheses

    • Definition: A hypothesis is a small, testable prediction structured as an "if-then" statement.
    • Example Statement: "If notifications interrupt learning, then students who study with notifications turned off will score higher."
    • Falsifiability Requirement: A hypothesis must be framed so that potential disconfirming evidence can be identified beforehand.
    • Result Outcome 1: If the notification-off group scores higher, the hypothesis is supported.
    • Result Outcome 2: If the notification-off group scores lower or shows no score change, the hypothesis is not supported, indicating that other variables are driving low test scores.

  • Deductive versus Inductive Reasoning

    • Deductive Reasoning:
    • Sequence: Begins with an Idea/Theory, followed by a Prediction.
    • Example: Starting with the idea that individuals raised with dishwashers never learned manual dishwashing, predicting that a specific roommate raised with a dishwasher will leave dishes in the sink.
    • Inductive Reasoning:
    • Sequence: Begins with real-world Observations, followed by an Idea/Theory.
    • Example: Observing across a full semester that unwashed dishes pile up in the sink specifically during exam weeks, subsequently deriving the idea that exam stress or study schedules drive dish accumulation.

Historical Foundations and Key Figures in Psychology

  • Key Historical Figures and Dates

    • American Psychological Association (APA): Founded in the year 18921892 as a central organization for scholars to aggregate psychological ideas.
    • Margaret Flo Washburn: The first female to earn a doctoral degree (Ph.D.) in psychology.
    • Mary Wycking Calkins: The first female president of the American Psychological Association (APA), elected in 19051905.

  • Academic Assessment and Reading Context

    • Approximately 95%95\% of quiz and exam questions are drawn directly from presented slide content and lectures, with 5%5\% allocated to specific textbook reading details.

Methodologies in Psychological Research

  • Case Study Method

    • Definition: An in-depth investigation focused on a single individual or a single organization when large sample sizes are impossible due to extreme rarity.
    • Case Example: Christa and Tatiana Hogan, conjoined twins featuring an exceptionally rare neural connection near their thalamus.
    • Primary Advantage: Enables scientific inquiry into extremely rare phenomena.
    • Primary Limitation: Lacks generalizability; findings from one subject or twin pair cannot be automatically applied to the broader population.

  • Naturalistic Observation

    • Definition: Observing and recording behavior directly in its natural context without researcher interference.
    • Hypothetical Example: Observing library patrons' phone usage during study sessions.
    • Primary Advantage: Captures genuine behavior in real-world contexts.
    • Primary Limitations:
    • Lack of experimental control over situational variables, timing, and environmental factors.
    • Requires significant time, financial backing, and luck.
    • Reactivity / Observer Influence: When participants know they are being observed (e.g., after signing research consent forms), they modify their behavior to present themselves favorably, ruining naturalistic authenticity.

  • Observer Bias and Inter-Rater Reliability

    • Observer Bias:
    • Occurs when an observer's subjective expectations influence data collection.
    • Prevention: Establishing explicit, predefined operational rules prior to data collection.
    • Example: Differentiating between a student picking up a phone as a distraction versus opening a course application to access study material.
    • Inter-Rater Reliability:
    • Definition: The degree of agreement among independent observers recording the same event.
    • Practical Application (Industrial-Organizational Psychology Context): In recruitment and hiring evaluations, independent raters assess recorded audio interviews without video (to eliminate visual bias) on a scale from 11 to 55. High agreement (e.g., both rating a candidate 33) demonstrates inter-rater reliability. Disagreements (e.g., one rating 11 and another rating 55) trigger systematic review.

  • Survey Research

    • Definition: Gathering self-reported data from a large sample through standardized questions.
    • Context Example: Surveying students regarding how frequently notifications interrupt study sessions.
    • Primary Advantages: Fast, cost-effective, and capable of generating high response volume ("reps").
    • Primary Limitations:
    • Lacks analytical depth.
    • Self-Reporting and Social Desirability Bias: Respondents may rush, answer carelessly, or provide untruthful answers due to self-image concerns, even when anonymity is guaranteed.

  • Archival Research

    • Definition: Analyzing existing data sets collected previously by other entities.
    • Example: Utilizing United States Census data collected every 10 years10\,\text{years}.
    • Primary Advantages: High efficiency; eliminates participant recruitment, scheduling conflicts, and participant tardiness.
    • Primary Limitations: Researchers must accept pre-existing data limitations, potential data contamination, or absent variables without ability to alter original data collection methods.

  • Longitudinal Research Design

    • Definition: Tracking and re-testing the exact same cohort of participants repeatedly over an extended duration.
    • Example: Tracking a specific student cohort continuously across 4 years4\,\text{years} from freshman to senior year.
    • Personal Academic Context: Earning a bachelor's degree took 12 years12\,\text{years} due to transferring from a private college to a local community college following freshman year.
    • Primary Advantage: Captures true individual development and intra-person change over time.
    • Primary Limitation: High rate of Attrition (participant drop-out due to life changes, relocation, financial constraints). Dropped participants cannot be replaced mid-study.

  • Cross-Sectional Research Design

    • Definition: Comparing multiple distinct age groups or cohorts simultaneously at a single point in time as a faster alternative to longitudinal designs.
    • Example: Surveying individuals in their 20s20\text{s}, 30s30\text{s}, 40s40\text{s}, and 50s50\text{s} regarding attitudes toward Artificial Intelligence in the workplace.
    • Primary Advantage: Provides rapid comparison across age groups without multi-year tracking or attrition.
    • Primary Limitation: Differences may reflect generational experiences (cohort effects) rather than pure developmental aging. Younger age groups (20s20\text{s}) generally display higher comfort with technology compared to older cohorts (50s50\text{s}).

Empirical Scenario Application and Method Review

  • Question 1: Traumatic Brain Injury and Attention

    • Scenario: Studying how one unusual traumatic brain injury affects attention.
    • Methodology: Case Study.
    • Feature: Involves a rare occurrence.
    • Strengths: Permits study of rare conditions.
    • Weakness: Low generalizability to broader populations.

  • Question 2: Self-Reported Notification Interruptions

    • Scenario: Investigating how often APSU students say notifications interrupt studying.
    • Methodology: Survey.
    • Feature: Relies on self-reporting.
    • Strengths: Fast and inexpensive data collection.
    • Weakness: Lack of respondent honesty and data integrity.

  • Question 3: Behavioral Analysis of Phone Usage

    • Scenario: Observing what students actually do with their phones while in the library.
    • Methodology: Naturalistic Observation.
    • Feature: Measures behavior directly in context.
    • Strengths: Observes actual behavior in real-world settings.
    • Weakness: Participants alter behavior if aware of observation.