CHAPTER 8 PSYC 3311

Chapter 8: Procedure for Conducting a Research Study

Learning Objectives

  • 8.1 Outline the IACUC and IRB review processes.
  • 8.2 Describe how to select participants for a research study.
  • 8.3 Explain the importance of sample size and the concept of statistical power.
  • 8.4 Explain the role of research instruments/apparatus.
  • 8.5 Summarize the procedural details to be carried out for a research study.
  • 8.6 Explain why it is important to conduct a pilot study prior to data collection.

Chapter Outline

  • Researchers design studies to answer research questions
    • Identify the relevant independent variables (IV) and dependent variables (DV)
    • Control for extraneous variables
    • Decisions to be made about conducting the study
    • Design provides only the framework of the study
      • The kinds of participants to be used
      • How many participants
      • How the participants will be obtained
      • Human participants
      • Instructions, tasks, and measures
  • Principles in this chapter apply to both experimental and nonexperimental research
  • Chapter is about implementation of a research plan
    • Institutional approval
    • Selection of participants
    • Sample size
    • Selection of appropriate instruments
    • Scheduling participants
    • Obtaining informed consent for participants
    • Instructions, data collection, and debriefing

Institutional Approval

8.1 Outline the IACUC and IRB review processes.

  • Nonhuman Animals as Research Participants

    • Approval from the Institutional Animal Care and Use Committee (IACUC) is required.
    • IACUC reviews to determine if the proposed study is ethically acceptable.
    • IACUC evaluates:
    • Procedures to minimize pain/discomfort to animals.
    • Use of sedatives or analgesics for procedures causing more than momentary pain.
    • Appropriate preoperative and postoperative care for surgical procedures.
    • Compliance with accepted euthanasia methods.

  • Humans as Research Participants

    • Approval from the Institutional Review Board (IRB) is required.
    • IRB reviews research protocols to ensure:
    • Ethical treatment of human subjects.
    • Participants provide informed consent.
    • Procedures will not harm participants.
    • Primary concern of IRB is the welfare of human participants.

  • Decision-Making for Potential Harm

    • Difficult when studies involve potential harm (e.g., administering experimental drugs).
    • Consideration of potential benefits relative to risks.

  • Receiving approval from IACUC or IRB is a crucial step before data collection.

Research Participants

8.2 Describe how to select participants for a research study.
  • Psychologists investigate behavior across various organisms.
  • The research question dictates the type of organism to be used:
    • Example: A study on imprinting may select ducks.
  • Most psychological research focuses on human behavior, including attitudes, emotions, and cognition.
    • Humans and albino rats are the most commonly used participants.
Obtaining Animals
  • The Animal Welfare Act (2013)
    • Regulates the care, handling, treatment, and transportation of animals for research.
    • National Academy of Sciences Institue of Laboratory Animal Research (ILAR):
    • Guide for the Care and Use of Laboratory Animals.
    • Assists institutions in ethical use and management of laboratory animals.
    • Aligns with policies from the NIH and AAALAC.
Obtaining Human Participants

  • Inclusion and Exclusion Criteria

    • Defined by factors such as age, disorder, or experiences relevant to the study.

  • Recruitment Strategy

    • Influenced by required participant type (e.g., contacting homeless shelters for studies on homeless individuals).
    • Recruitment impacted by available resources.

  • Most human psychological research uses a convenience sample:

    • Typically conducted at colleges or universities (students often fill the participant pool).

  • Participant Pool

    • Comprised mainly of introductory psychology students, motivated to participate for credits.
    • Provide a readily available supply but may limit external validity as findings may not generalize to non-student populations.

  • Some studies may require specific populations (e.g., kindergarten children, criminals).

    • Collaboration with community partners is essential for gaining access.
    • Consent from parents for minors and assent from children should be obtained.

  • Internet as a Recruitment Tool

    • Useful for reaching diverse and harder-to-access populations:
    • Includes individuals from different cultures or backgrounds not limited by geographic constraints.
    • Challenges arise from ensuring representativeness and contacting participants effectively.
    • Various platforms such as Mechanical Turk can be used for online studies.
Selection of Individual Participants

  • Random Selection

    • Ideally, participants should be randomly selected from the broader population of interest.
    • Practical issues exist for large, dispersed populations, leading to reliance on convenience and availability.

  • Important factors to report include:

    • Nature of participant selection and assignment.
    • Characteristics of selected participants for replication and result compatibility assessments.

Sample Size

8.3 Explain the importance of sample size and the concept of statistical power.

  • Determining Sample Size

    • Needs based on:
    • Study design.
    • Variability of data.
    • Statistical procedures used.

  • Design Relation

    • Examining differences between single-case and multi-participant designs:
      • Single-case requires only one participant, while a multi-participant design can range widely.

  • Statistical Power

    • Defined as the probability of rejecting a false null hypothesis (the null hypothesis suggests no relationship exists between IV and DV).

  • High power (above 0.80) means you correctly reject a false null 80% of the time.

Factors Influencing Power
  • Determinants of power include:
    • Sample size.
    • Effect size (magnitude of relationship between IV and DV).
    • Alpha level (usually set at 0.05).
    • Statistical test type used.
  • An increase in sample size enhances power, but comes with increased costs (time/money).
Power Analysis

  • Power analysis determines the minimum required sample size for adequate testing of hypotheses.

  • Example of Effect Sizes via Jacob Cohen (1992):

    • Correlation coefficients:
    • Small: 0.10, Medium: 0.30, Large: 0.50
    • Differences (Cohen's d):
    • Small: 0.20, Medium: 0.50, Large: 0.80.

  • Use of Table 8.1 to determine sample sizes for different tests and conditions.

  • G*Power Software

    • Free tool for determining necessary sample size for studies.

Apparatus and/or Instruments

8.4 Explain the role of research instruments/apparatus.

  • Research conditions must allow IV to be effectively manipulated and DV accurately measured.

    • Example: Presentation of IV could involve showing text on a screen for varying durations requiring precise control (often done via computer).
    • DV measurement example: Heart rates are better recorded electronically than manually.

  • Measurement Tools

    • Automatic recording devices increase accuracy by minimizing human error due to bias.
    • Common apparatuses include:
    • Brain wave measurement: EEG, PET, MRI.

  • Principal need: Choose appropriate apparatus for both IV manipulation and DV recording which aligns with methodology.

Procedure

8.5 Summarize the procedural details to be carried out for a research study.

  • Prior specification of detailed procedures is vital before commencing the study.

    • For animal research: Handling, environmental conditions, and transport protocols must be determined.

  • Human Research Protocols

    • Researchers must outline:
    • Tasks for participants.
    • Greeting methods (e.g., nonverbal communication, tone).
    • Verbal engagement strategies.
Scheduling of Research Participants

  • Scheduling must consider participant availability and researcher capacity. Factors:

    • Lighting Cycles for Animal Studies: E.g., rats are active at night, thus scheduling should align with their behavior, balancing the convenience for the experimenter and the well-being of subjects.

  • Researchers should allow for flexibility in rescheduling to account for participant absenteeism.

Consent to Participate
  • Informed consent is mandatory and outlines:
    • Study purpose and procedures.
    • Potential benefits and compensation.
    • Right to refuse or withdraw without penalty.
    • Confidentiality assurance regarding data.
    • This documento must be written in layperson's terms for accessibility.
Instructions for Participants
  • Instructions should encompass:
    • Clear descriptions of the study and tasks.
    • Should avoid complex language but be explicit and repetitive for understanding.
  • Warm-up trials are recommended to acclimate participants.
Data Collection
  • Follow outlined procedures closely to ensure consistency for each participant, crucial for validity.
Debriefing

  • Debriefing should follow data collection, informing participants about the study:

    • Tesch's three functions:
    • Ethical: Address potential deception.
    • Educational: Clarify research purpose for learning.
    • Methodological: Gather feedback on IV manipulation effectiveness.

  • Debriefing can occur through forms or interviews. Researcher should encourage participant questions and provide full explanations about the study.

Pilot Study

8.6 Explain why it is important to conduct a pilot study prior to data collection.

  • Conducting a Pilot Study

    • A preliminary investigation on a smaller number of participants, essential before the main study.
    • Provides insight on:
    • Clarity of instructions.
    • Effectiveness of IV manipulation.
    • Sensitivity of DV.
    • Researcher’s familiarity with procedures.

  • Conducting online studies entails testing tasks yourself and resolving any browser issues affecting data retrieval.

  • Detecting issues late can skew actual data; changes post-IRB approval demand re-approval.

Multiple Choice Questions

  • Sample questions related to IACUC, IRB protocols, participant recruitment strategies, etc.

Vocabulary Definitions

  • Debriefing: The process of informing participants post-study about its purpose and procedures, including addressing any deception.
  • Effect Size: Magnitude of the relationship between the independent variable and dependent variable, indicating the strength of experimental effects.
  • Pilot Study: A preliminary research effort involving a small number of participants used to refine methodologies before full-scale studies commence.
  • Postexperimental Interview: A discussion session after the study to address participant feedback and clarify study-related queries.
  • Power: The statistical ability to correctly reject a false null hypothesis indicating a real effect exists.

Essay Questions

  1. Discuss the approval process of IACUC and the concerns associated with animal research protocols.
  2. Describe participant selection procedures in human research and associated concerns.
  3. Evaluate internet use for recruiting participants and its pros/cons.
  4. Outline considerations for determining an appropriate number of participants in a study.
  5. Define power and explain how sample size impacts it.
  6. Describe effect size and its influence on statistical power.
  7. Discuss advantages of automating experimental procedures.
  8. Identify important elements in a consent-to-participate statement.
  9. Considerations for constructing instructions for research participants.
  10. Describe debriefing and its three functions.
  11. Suggested procedure for conducting debriefing following participation.
  12. Define what a "pilot study" is and outline its importance.