Interpreting Research Findings: A Comprehensive Guide

Contact Information for Course Instructor

To contact the course instructor, refer to the following:

• Location of the office:
  • Building:
  • Floor:
  • Office Number:
• E-mail:
• WhatsApp:
• Via the Section Leader

Session Learning Outcomes

By the end of this session, students will be able to:

1. Assess the quality and relevance of research findings.
2. Differentiate between statistical significance and clinical significance.
3. Incorporate research findings into clinical decision-making processes.
4. Articulate the principles for interpreting research results in health sciences.
5. Outline the key components and stages involved in discussing scientific research.

Interpreting Research Findings: Part One

An Overview of Research Interpretation

• Definition: Research interpretation is the process of making sense of research findings and translating data into meaningful insights.
• Importance: Accurate interpretation influences:
  • Clinical practice: It helps in applying research to patient care.
  • Public health policy: It informs health initiatives and regulations.
  • Future research directions: It guides new studies based on identified gaps and outcomes.

Key Components of Interpreting Findings

1. Understand the context of the study.
2. Assess the reliability and validity of the results.
3. Evaluate the consistency of findings with existing literature.

Questions to Consider:

1. What were the main findings?
2. Are the results statistically and clinically significant?
3. How do these results fit into the broader field?

Analyzing Methods

• Population Characteristics:
  • Inclusion criteria (e.g., age, gender, health status).
  • Exclusion criteria (e.g., comorbidities).
• Intervention Details:
  • Description of what was tested (e.g., dosage, duration).
  • Comparison groups (e.g., treatment vs. control).
• Outcome Measures: Clearly defined metrics for assessing results (e.g., incidence rates, quality of life).

Interpreting Results: Data Presentation

• Importance of clear tables, charts, and graphs.
• Need for transparency in presenting data.

Statistical Analysis

• Discuss terms such as mean, median, and standard deviation.
• Explanation of how statistical tests (e.g., t-test, chi-square) were applied.

Effect Size

• Understanding statistical measures used to assess the magnitude of an effect.

Statistical Significance Vs. Clinical Significance

• Statistical Significance:
  • Indicates whether the results are likely due to chance, commonly assessed using p-values (e.g., p < 0.05).
• Clinical Significance:
  • Relates to the real-world importance of the findings; a result may be statistically significant but not clinically impactful.
• Example:
  • A study may find a statistically significant reduction in blood pressure; however, if the decrease is too small (e.g., 1 mmHg), it may not translate to improved health outcomes for patients.

Statistical Significance: Definition of p-value

• It indicates the probability that the observed results occurred by chance.
• Common Thresholds:
  • p < 0.05 is considered statistically significant.
  • p < 0.01 for more rigorous standards.
• Limitations of p-values:
  • Misinterpretation can lead to overconfidence in results.
  • Emphasizing the significance of factors such as demographics, setting, and sample size.

Assessing Research Quality

• Study Design Appropriateness:
  • Relevance of design (e.g., RCT vs. observational) to research question.
• Bias Recognition:
  • Understanding types of bias (e.g., selection, performance, and detection biases).
• Validity and Reliability:
  • Internal validity: Are the results specific to the study?
  • External validity: Can the results be generalized to the broader population?

Interpreting Results: Drawing Inferences

The goal of interpreting research results is to draw inferences about the nature of the universe around us. Two major sets of inferences:

• External validity
• Internal validity

The Validity of a Research Study

• The validity of a research study also refers to how well the results among the study participants represent true findings among similar individuals outside the study.
• This concept of validity applies to all types of clinical studies, including those about prevalence, associations, interventions, and diagnosis.
• The validity of a research study includes two domains: internal and external validity.

Internal Validity vs. External Validity

• Internal Validity: Extent to which the experiment is free from errors & any difference in measurement is due to the independent variable.
• External Validity: Extent to which the research results can be inferred to the world at large.

Internal Validity: Definition

• The extent to which a study accurately demonstrates a causal relationship between variables.
• Factors Influencing Internal Validity:
  • Study design elements such as randomization and the presence of control groups.
  • Adequate sample size and careful selection processes.
  • Control of confounding variables and biases.
• Importance: High internal validity increases confidence that observed results are due to the treatment or intervention being studied.

Internal Validity Cont’d

• Internal validity is the degree to which the investigator draws the correct conclusions about what actually happened in the study.
• Example: The objective of the study was to evaluate depression mood; however, the questionnaire employed is designed to assess stress and burnout.

External Validity: Definition

• The degree to which findings can be generalized to broader populations beyond the study sample.
• Factors Influencing External Validity:
  • Sample characteristics, including age, gender, and ethnicity.
  • Settings and contexts in which the study was conducted.
• Importance: High external validity enhances the applicability of findings to real-world scenarios and diverse populations.

External Validity Cont’d

• The degree to which these conclusions can be appropriately applied to people and events outside the study.
• Also called generalizability.
• Example: The research was conducted at the Foundation Year at PNU and found that the average age of students is between 17 and 19. However, the researcher has concluded that students at PNU are younger than all students in other universities in the Kingdom.

Ensuring Validity in Research: Enhancing Internal Validity

• Use Random Sampling: Minimizes selection bias and ensures that each participant has an equal chance of being included.
• Control Variables: Identify and control for confounding variables that could potentially affect outcomes.

Ensuring Validity in Research: Enhancing External Validity

1. Diverse and Representative Sample: Ensure the sample reflects the population in terms of demographics and characteristics to facilitate generalizability.
2. Conduct Studies in Varied Settings: Test research findings in different contexts to assess applicability across diverse scenarios.

Limitations of Research: Common Limitations

• Sample Size:
  • Often too small to generalize findings to a larger population.
  • Discuss implications of underpowered studies leading to inconclusive results.
• Selection Bias:
  • Non-random selection can lead to results that are not representative of the broader population.
• Confounding factors:
  • Other factors (such as age, gender, lifestyle such as smoking), genetic factors, comorbidities, and medication use may influence research results, leading to incorrect conclusions.

Ethical Considerations in Research

• Adherence to ethical standards, including informed consent and protection of confidentiality.
• Awareness of potential conflicts of interest that may influence research outcomes.

Conclusion: Key Takeaways

Always consider the following when interpreting research findings:

• The importance of the interpretation of results in research.
• The distinction between statistical and clinical significance.
• Communication of research findings clearly to patients and colleagues.