ISD5
Plan
Design
Report
Research Plan
“Research design refers to the overall strategy utilized to carry out research that defines a succinct and logical plan to tackle established research question(s) through the collection, interpretation, analysis, and discussion of data”
Research Design
Research is:
• Complex
• Challenging
• Time consuming
• Expensive
1. Identify the research problem
2. Review the literature
3. Specify clear hypotheses (questions)
4. Describe the necessary data to test the hypothesis and how it will be collected
5. Outline the data analysis which will be applied
General Design
• Design is a discipline
• Important to healthcare
• Identify a problem
• Research the problem
• Define the problem
• Create Research Question
• Outline evidence needed
Research Design
1. Identify the research problem
2. Review the literature
What knowledge or theories currently exist?
• Philosophical
• Contextualisation of the research
• Beliefs, philosophy and incentives
Not all research is equal
Not all research is conducted for the “right” reasons
Not all research should be trusted
Hierarchy of Evidence
Meta-analysis: →Statistical merging of individual studies to estimate pooled effect
Systematic Review: →Review multiple studies to assimilate findings of primary research
Randomised Controlled Trial: →Participants randomised into intervention or controls
Cohort: →Identify participants and assess their outcome of interest
Case-Control: →Identify Cases with disease and match to controls
Case Report: →individual case findings and management
Expert Opinion: →People agree on what is considered best practice
Epidemiology
“The study of how often diseases occur in different groups of people and why”
“Epidemiological Data is used to plan and evaluate strategies to prevent illness and as a guide to the management of patients in whom disease has already developed”
RCT: Experimental
CS, CC, and CR: Descriptive
Tooth Decay
How many children have tooth decay in Merseyside?
If we :
Access children's dental records
Record the number of children with caries
Descriptive
Cross-sectional (Prevalence)
Which children are more likely to get decay?
Retrospectively
Which children are more likely to get decay?
Prospectively
Experimental Studies
True Experimental Design:
1. Introduce an intervention or manipulate a variable
2. Perform randomisation of participants
3. Include an experimental control group
Randomised Control Trial
Randomised Control Trial
• Not feasible to conduct research with everyone
• The sample should represent the entire population
• Randomisation ensures confounding factors are evenly distributed
• Statistical "power" refers to the probability of actually detecting an effect if there is a true effect to detect.
Randomised Control Trial Phases
Phase 0 – Earliest of drug trials – small number with low dose of drug.
Phase 1 – How much rug is safe to give, what are the side effects, does it help treat the disease
Phase 2 – Does the drug work well enough for larger phase 3 trial, which disease the drugs work best for, more information on side effects, better evidence for dose
Phase 3 – Large trials, comparing new drug to current standard of care.
Phase 4 – After drug has been licensed, investigates longer term effects and more wider use
UK Health Research Authority (HRA)
1. Is there a clear research question?
2. Will the proposed study design answer the research questions?
3. Are the assumptions used in the sample size calculation appropriate?
4. How will safety and efficacy be monitored during the trial?
5. How will the trial be registered and subsequently published?
Assessing Research Quality
What factors can influence the quality of the research?
Tooth Decay
Patients, Clinicians & Health care providers → What is best?
Important issues
Funding by large organisations
Involved experience researchers
Assess study design of primary studies
Provide guidance based on quality of evidence
Research Organisations
Cochrane
CASP – critical appraisal
Difficult to teach
Difficult to learn
Practice Appraisal
Checklists can help
Consider the Hierarchy of evidence
Research Proposal
Involve experts as early as possible
Research Support Service
Publishing Study Protocols
Pragmatic = Effectiveness i.e. in the real world
PICO
Population:
→ NHS patients aged 12 years and over with one or more carious lesion extending into the pulpal third of dentine
Intervention:
→ Selective Caries removal
Control:
→ Complete Caries removal
Outcome:
→ Primary -- Clinical effectiveness and Cost-Benefit of intervention vs control
→ Secondary – Pulp exposure, pain, restoration failure, OH QoL, PROMs
Research Question
• Often the starting point for research – Ask BIG questions!
• The pro pose d research should answer the question
• Can form the overall paper aim or be broken down into the objectives
• Should form from a thorough and systematic appraisal of current literature
• The question will influence the study design
• If there is no clear hypothesis – Think - Hypothesis-Generating Experiments
“What can we see in the data that might need investigating?
Perfection does not exist!
• Use multiple experiments to provide confidence in your results.
• Use multiple methods if necessary.
• Sometimes you need to validate your results with repeats or further experiments.
Research Aims and Objectives
Research Aims:
Statement of general aim of the purpose of the project
• Usually broad and introductory
Research Objectives:
Specific statements indicating the key issues being focused on in the project
• Usually multiple, specific topics to be investigated
Hypothesis Testing
• Research studies should have one, well-defined hypothesis:
Primary Hypothesis
• The hypothesis must be tested during the research.
• Measurable & Specific ‘Consumption of sport energy drinks increases the risk of dental carious lesion development’
Null Hypothesis
• No association between variable and disease
• Always good practice to assume the null hypothesis is true then run test
e.g. ‘There is no association between sport energy drink consumption and dental carious lesion development’
Independent Variable:
• the altered/changed variable e.g. sport energy drink consumption
CAUSE
Dependent Variable:
• the variable being tested and measured e.g. presence of decay (DMFT)
EFFECT
Primary Outcome Measure
• The outcome that is being investigated
• Defined before start
• Contributes to sample size calculation
• Avoid collecting data and then performing statistical analysis
DATA DREDGING
Interventions vs Controls
Intervention:
• Study group which receives the intervention or manipulation of the variable
Control:
• Study group which does not receive an intervention or where the intervention cannot influence the dependent variable (Placebo).
Correlative vs Manipulative Study Design
Correlative – identifies if there are correlations or associations between different aspects of the study population.
Manipulative – experimenter changes a variable to assess its impact on an outcome variable
Confounding Factors
• Variables that may falsely create an apparent association which doesn’t exist or which hide actual associations
e.g. coffee causes cancer… …coffee drinkers were smoking whilst having their coffee
Strategies for avoiding confounding factors:
1. Exclude: Selection criteria
2. Randomise: so confounders will be evenly shared between groups
3. Statistics: Identify the confounders and statistically account for them
Randomisation
• Participants can be assigned to all groups
• If groups aren’t balanced, then results are biased and not representative
• Minimises bias
• Simple
• Block
• Stratified
• Simple - AAAAAABAABAAAAA
• Block – AABBAB///ABAABB//BBBAAA
• Stratified – Grouped by strata and then randomised i.e. those with pain and those without.
Blinding/Masking
• Hiding the grouping/treatment from participant, investigator, statistician
Single: Investigator or Participant
Double: Investigator and participant
Ethical Approval
• Protect the participants (and their data)
• Beneficence – Doing what is best for the participant
• Non-maleficence – doing no harm and avoiding potential harm
• Autonomy – Respect for the participant's own independence and decision-making
• Justice – treat fairly
The responsibility of the principal investigator
Required for any research that involves human participants
• Fully informed
• Confidentiality
• Risks minimised
• Independence and conflict of interests should be explicit.
• All research facilities will have their own policy/guidelines to follow
NHS Ethics:
• Health Research Authority – Integrated Research Application System
University Ethics:
• UoL Form Manager
Patient & Public Involvement
Fundamental component of Health Research
Research "carried out ‘with’ or ‘by’ members of the public rather than ‘to’, ‘about’ or ‘for’ them. It is an active partnership between patients, carers and members of the public with researchers that influences and shapes research."
Discussing the outcomes
• Discuss the relevance of the results
• Explore the underlying meaning of your results
• Any implications for future practice or research
• Possible improvements in methodology
Presenting your research...
Presentations: Local, Regional, National & International
Poster
Oral
Publications:
Dissertation/Thesis
Online
Society/Conference papers
Peer-reviewed journals
The Abstract
• Short summary of your research paper
• Approx 250 words
• Format can be journal dependent
• Includes key findings
Summary
• Research design is fundamental to high quality, reliable research.
• Understanding key aspects of design helps interpret research and guidelines
• Involve experts early on in planning
• Involve patients to understand what impact the research will have/is having.
• Don’t believe everything ( most things) you read in the literature and online