EBCR I Quiz 1 Material
Intro to Drug Information: already in flashcards
Intro to the Library
Ethical & Legal Aspects of Drug Information
Copyright / Plagiarism / Citations
Introduction to Primary Literature
Research Methods
Intro to the Library
What do USF Health Libraries offer?
24/7 student study space
after hours access to Shimberg Library
Booking a study room or collaborative space
Access to computer lab and software
Copier, printing services, and poster printing
online access to journals and books off-campus
interlibrary loan services via lliad
library workshops
work with a librarian
Who has library building access?
USF faculty, staff, and students
all health faculty and students should automatically be added to the card permissions list upon registration for classes each semester
If you experience problems with card access, please visit WELL front desk or email usfhealthsss@heath.usf.edu
For quick questions, try email, chat, or knowledge base
For complicated questions, set up an appointment
To find books and journals, search the library catalog
General Reference books
AccessMedicine, AccessPharmacy, AccessSurgery
medical book titles, drug information, thousands of images, interactive self-assessments, case files, diagnostic tools, mobile app
LWW Health Library
medical education and pharmacy ebooks from Lippincott williams and Wilkins
Stat!Ref
Full-text cross-searachable reference books, includes Stedman’s Medical Dictionary, MedCalc3000, a unique computerized medical reference and tool set, and more
Thieme MedOne Education
over 110 e-textbooks covering entire medical school curriculum
Library Classes
Effective Searching and Databases Series
Writing and Publishing Series
Promotion and Tenure Series
Grants Series
Endnote
Effective Searching
Copyright/Plagiarism/Citations
What is copyright?
Copyright: form of protection by US law for original works of authorship (literary, dramatic, musical, artistic, etc)
Copyright protection exists as soon as work is fixed in tangible form (even a drawing on a napkin)
Lasts life of author + 70 years of exclusive rights to make copies, distribute, prepare derivatives, perform, and display publicly
Facts, names, short phrases, and methods are NOT protected by copyright (can be protected by patents)
Materials in public domain also not protected (copyright expired, forfeit, inapplicable)
Ex. Jane Austen’s pride and prejudice (expired)
Copyright can be given away or forfeit (creative common, cc zero., no rights reserved mark)
US federal government publications are in public domain
Works by third parties under government or state gov may be treated differently
How to use Copyrighted materials
Put a link to the material
Quote
Fair-use: allows others to use copyrighted material in specific scenarios
Depends on purpose and character of work, nature of original material, amount used of copyrighted material vs whole work, effect on original’s market
EX. Using short clip from film in documentary
Special exceptions to copyright
Libraries, schools, non-profits
Creative Commons licenses can tell what activities are allowed
Request permission from creator
Avoiding Plagiarism
Plagiarism: act of presenting another’s work or ideas as your own
“Kidnapping” someone else’s ideas
To avoid..
Directly quote material
When you cannot paraphrase or summarize without losing meaning
Can add credibility
Do not overuse (don’t parrot)
Paraphrase
Rewording in your own words
Summary
Integrates ideas
Shorter in length
Always cite!
Even professor’s lectures
Don’t cite when it is common knowledge or your own ideas
Something everyone would reasonably know (apples grow on trees, George Washington was president)
Start early, document sources as you go, and research well before starting to write to avoid plagiarism
Don’t copy and paste from original, don’t procrastinate!
Procrastination is biggest cause of plagiarism
Better to over-cite than take credit from someone else’s ideas
How to Cite Sources
When should you cite?
Did you think of it?
If not, cite
Is it common knowledge
If not common fact or saying, cite
Why should you cite?
Avoid plagiarism
Establish credibility
Help readers find the original materials
Citation style to use: AMA (also called JAMA)
Uses numbered endnotes that are placed in your text as superscript numbers with a References list at the end of the text in the order that the citation was used
Parts of a Citation
Authors
should list author’s surname followed by initials WITHOUT periods
For 1-2 authors: list all authors in reference list and in-text citations
For 3-6 authors: List all authors in reference list and 1st author followed by et al or “and colleagues” in-text citations
For 7+ authors: List first 3 authors followed by et al. in reference list, list 1st author followed by et al or “and colleagues” in-text citations
Article Title & Subtitle
use sentence capitalized (capitalize only first word and proper nouns, do not capitalize after colon)
Journal Title (abbreviated)
Capitalize all major words
Italicize titles
Find correct journal title abbreviations using National Library of Medicine Journals list
Year of publication/online pre-publication date
For published articles, YEAR followed by semi-colon
For articles online ahead of print/online journal, “Published online Month Date, Year” followed by period
If no volume, issue, or page numbers included, skip
If multiple dates, use MOST RECENT
Volume
issues collected into volumes, typically one year’s worth of issues
Year; Volume(issue):startpage-finalpage.
Issue
Each publication is an issue
Page range/e-locator
Should include the entire range of pages
DOI
Digital object identifier
unique permanent number given to each article (and other electronic resources)
if doi is shown within a URL, start with the 10.xx
if no DOI, use URL+access date
Introduction to Primary Literature
Classifications specific to pharmacy:
Primary: direct access to data
Secondary: abstracting or indexing search engines; facilitate location of primary and tertiary literature
Tertiary: indirect access to data; author interpretation of the literature
Primary Literature
Research methods
Evaluative (Experimental, Observational) or Descriptive
Identified via review of secondary and tertiary literature
Predominantly journal articles
Secondary Literature
indexing and abstracting services
index: citation only
abstract: citation plus description of article content
Facilitates search for tertiary and primary literature
Content varies per service
Tertiary Literature
Textbooks (general or specialty)
Compendia (computer databases)
Review articles
Evidence-based guidelines and consensus statements
package inserts
internet resources
Alternate/Unclassified Resources
Expert opinion
Pharmaceutical industry
Professional list servs
Primary Literature
Written accounts of original thought or discovery directly derived from first-hand observation or research
Introduces new evidence into the existing body of scientific knowledge
commonly published in medical or health-related journals
not all literature in journals is primary
not limited to journals
Examples of Primary Literature
Clinical research studies and reports (randomized controlled trials, cohort studies, case series, case reports)
Posters presenting original research
Sections of a Primary Literature Article
Title/Authors
Abstract
Overview of most important aspects of article
Allows reader to quickly determine if he/she wants to read entire article
Should not rely on abstract alone when reading
Introduction
Background info and rationale for research
study objectives
Methods
Describes how study was conducted
study design
patient selection/recruitment process
interventions used and process for use
how endpoints were measured
how data were collected
planned statistical analyses
Results
Description of data/findings
Statistical analysis of data
Discussion
Author’s interpretation of the results and the impact of the study
comparison to other studies
trial strengths and limiations
suggested directions for future research
Conclusion
summary of what authors feel is the ultimate impact of the study
References
Advantages and Disadvantages of Primary Literature
Advantages:
Original, current info
Detailed info
Open for reader’s own assessment of validity and applicability of study results
Disadvantages:
Conclusion based on one trail may eb misleading without context of other research
Reader must have good literature evaluation skills
Time-consuming
Costly and/or difficult to obtainIntro to Medical Journals
Types of medical journals:
General Focus
cover variety of disciplines and medical conditions
ex. New England Journal of Medicine, Journal of the American Medical Association
Specialty focus
covers specific medical conditions, organ systems, or patient populations
ex. Diabetes Care, Pediatric
Factors which increase reputability and credibility of journal
Peer Review
Editorial Board
Accept Correspondence
Affiliated with a professional organization
low advertisement to text ratio
Impact Factor
Average number of times the articles in a journal were cited during a period of time
Rating related to importance the scientific community places on articles published in a journal
higher impact factor = greater scientific influence
Research Methods
Categories of Research:
Evaluative
primary goal: answer a question
Experimental: measure interventions
Clinical trials
Meta-analysis
Pharmacoeconomic (PE)
Health Related Quality of Life (HRQoL)
Observational: examine specific data sources for the purpose of identifying relationships surrounding specific events or outcomes
Cohort
Case-Control
Cross-sectional/Survey
Article sections: Title, Authors, Abstract, Introduction/background, Methods, Results, Discussion, Conclusion, References
Descriptive
primary goal is to report individual experiences
typically lack hypothesis or scientific principles
findings often lead to the development of evaluative studies
Cohort, Case-control, cross-sectional, case-report/clinical series,
Overlap with observational research!
Article sections: Title, Authors, Abstract, Introduction/background, Observations (combo of methods and results), Discussion, Conclusion, References
Section Content Overview
Introduction/Background
Literature review
Study objective and hypothesis
Methods, statistics, and results are inter-related
Methods determine type of results, collected data determines statistical analysis
Results should follow methods and address all planned analysis
Discussion: interpret results (no new data/findings), relate to existing literature, address limitations and future research
Methodolgy
Sample Description
Demographics
Size
Inclusion/Exclusion criteria
Blinding
Single: participants unaware of intervention allocation
Double: Both participants and researchers unaware of intervention allocation
Open-label: No blinding
Control group(s)
Placebo: physically identical to intervention, no therapeutic effect
Active: comparable treatment given
seek equivalency, inferiority, or superiority regarding desired effect
Administration of intervention
Parallel: concurrent administration
Crossover: Participant serves as their own control
receive both interventions with washout period in-between
Allocation of intervention
randomized: computerized process that generates allocations without patterns
nonrandomized or random allocation: process that has no randomization or utilizes a distinct pattern
Number of sites
single: one physical location/organization
multiple: broad, more diverse practice or several organizations
impact patient factors and ability to generalize results to other populations
Outcomes (ECHO)
Economic
evaluation of costs and associated consequences
cost effectiveness, cost-benefit, cost-utility, cost-minimization
Costs
Direct:
Medical: monies spent on healthcare
Non-medical: monies spent while obtaining healthcare (ex. time off work, transportation)
Indirect:
Monies lost secondary to morbidity
Monies lost secondary to mortality (death)
Intangible
Related to disease or treatment
Value attributed to pain, suffering, and/or distress
Clinical
Biologic and physiologic changes
Lab findings, physical findings
Usually focus on events
disease-related, drug-related, other interventions
Humanistic
Effect an intervention has on an individual
Health-related quality of life
Satisfaction
Functional status
Physical, Psychological, Social
Symptoms associated with a disease or treatment
Cultural or ethnicity-related beliefs
Measurement Domains
Instruments: questionnaire or survey
General: health profiles, utility analyses
Disease-specific
Administration: self or investigator
Operational
Assessment of how perceptions or behaviors changed (operationally) as a result of an intervention
impact and implications
Utility
Many perspectives considered (patient, provider, payer, society)
Clinical practice (formulary management, clinical practice guidelines, justification of services/programs)
Pharmaceutical industry (drug development, pricing)
Clinical Trials
Purpose: to evaluate cause and effect
Design: true experiment or quasi-experimental
quasi-experimental: groups are not randomly assigned
Prospective
Involve some type of intervention
laboratory; animal or human
Pharmaco-
Therapeutic: medication, procedure, physiologic manipulation, behavioral
Kinetic: absorption, distribution, metabolism, elimination
Dynamic: pathophysiologic
Methodology
Key components: Sample, Blinding, Control group(s), administration parameters, intervention allocation, number of sites, outcome variables
Analysis
predominantly inferential: dealing with data sets
set a priori (before study begins)
based on type of data (nominal, ordinal, interval/ratio)
usually includes alpha value (p-value)
reflects type one error (false positives) to support when to accept or reject the null hypothesis
traditional level of significance is <0.05
may include beta value (power)
reflects type two error (false negative) or ability to detect differences between groups
used to determine appropriate number of participants in each allocation arm
Advantages: best way to measure cause and effect
Disadvantages: time intensive, expensive, may be unethical
Meta-Analysis
Study of studies
Does not directly involve patients, an outcome, or intervention
combination and statistical analysis of results from previously conducted studies (clinical trials, cohort, case-control)
WILL develop hypothesis
Similar to a review article in approach but findings are substantiated by the determination of statistical relationships
By combining data (increasing participants), relationships may be better appreciated
Method section will include:
Search strategy description
detailed description of strategy used to identify studies
typically entails both computerized and manual efforts (tertiary lit, secondary lit, alternate resources)
Article review process description
Description of reviewers
minimum 2
evaluate and rank articles based on a comparison of method sections
blinded to author, title, publication source, and results
Inclusion/Exclusion Criteria
determined a priori
description of required methodologies and data extraction process
description of excluded studies will be listed within the text of the document or table
Data collation
aka pooling: combining results from included studies
prior to pooling, investigators will perform statistical analyses to ensure homogeneity
Statistical data classification
Nominal: comparing effects not participants
Variants of chi-square
Results usually presented as odds ratios with 95% confidence intervals
Additional analyses
sensitivity analysis: performed to see whether inclusion of different variables influences circumstances
logistic regression: clarify magnitude of significance when confounding variables
Advantages: If results from individual trails are inconclusive or conflicting, meta-analysis can further evaluate previously identified associations, enhance power, and provide direction for future research initiatives
subground analysis, post hoc analysis
Disadvantages: Retrospective, publication bias (if investigators can only find published studies), internal validity (identified relationships will not be pure), will not confirm cause/effect
Cohort Analyses
Purpose: to determine the relationship between risk factor exposure and outcome(s)
evaluate risk
goal: establish causation (not as pure as relationship determined by clinical trial)
determine incidence
Investigators should have some suspicions that the relationship is possible
Findings from literature used to support hypothesis
Usually prospective, may begin with a retrospective review before moving forward
Obtain pre-determined baseline information
Methodology:
select a duration of follow-up that is long enough to realize outcome of interest
tend to be very long
enroll a sufficient number of patients (power)
power analysis performed so investigators know number of patients required before study begins
Many cohorts include cases (exposed), controls (not exposed)
Comparable groups to include in cohort should have similar:
Demographics
Prior healthcare
Monitoring parameters within trial (physical examination, labs, procedures)
standardized methods
equal access
similar evaluation time frames
Historians: recall bias
inability to recall can introduce bias
Compliance
can be difficult because of longitudinal nature of cohorts, some may drop-out, withdraw
Statistics:
Relative Risk
A measure of the risk of a certain event happening in one group compared to the risk of the same event happening in another group
1 = identical risk (reference value)
<1 = lower risk
>1 = higher risk
Confidence intervals
used to quantify magnitude of relationship
wider confidence interval = more likely relationship is due to chance
confidence intervals that include 0 are null/void
Attributable risk
evaluating incidence vs. outcomes
statistics differentiate causation from chance occurrence
Advantages: investigators determine sample characteristics, evaluation parameters/techniques
Disadvantages: May require long duration of follow-up depending on outcome, may be expensive, difficulties may arise with maintaining controlled factors, dropout rates increasing with time, membership bias (difficult to determine whether outcome is secondary to risk factor or to group characteristics), surveillance bias (circumstances associated with investigation affect outcome
Case Control Analyses
opposite of Cohort
Purpose: to determine which prior risk factor may be contributing to an observed outcome
evaluate risk
establish causation
examine prevalence
Retrospective; often used to determine the need for prospective analyses
Methodology:
Before study is undertaken, investigators determine suspected risk factors for an outcome
must be literature support/evidence
Cases and controls identified by the investigators are matched
Cases: with outcome
Controls: without outcome
Must be comparable groups (demographics, access to healthcare, recall ability should be good)
key determinant: how well groups are matched
Methods should include description of matching process in regard to Beta or power
Common for mismatch between case number vs controls (number of controls may be much higher than cases)
Investigators retrospectively review records and perform interviews to determine risk factor exposure
both groups may or may not have risk factor exposure
Individuals involved with data extraction/interviews are blinded to study intent and patient circumstances to avoid deviation and reduce bias
protocols developed to insure appropriate and accurate data collection
Predetermine inclusion/exclusion criteria, suspected risk factors, definition of exposure, criteria and statistical methods used to determine existence of relationships
avoid data mining
Statistics
Odds ratios or variance
The OR represents the odds that an outcome will occur given a particular exposure, compared to the odds of the outcome occurring in the absence of that exposure
1 = identical odds
<1 = lower odds
>1 = higher odds
Confidence intervals (95%)
used to quantify magnitude of relationship
Regression analysis
further quantify relationship between different variables
identify best fit line to describe relationship between data points
more linear = more likely relationship
direction =.postive or negative relationship
Advantages: investigating rare diseases, evaluating diseases that develop/progress slowly, investigating ethically sensitive issues, less expensive, quicker to perform, able to identify multiple risk factor associations
Disadvantages: rely on accuracy/completeness of database, risk factor and outcome data collected simultaneously makes identifying relationships challenging, recall/surveillance bias, protopathic bias (making the appropriate risk factor to outcome correlations
Cross-sectional analysis
purpose: to evaluate an outcome (opinions, environmental circumstances, disease states, or interventions) at a single, specified period in order to determine prevalence and develop ideas for future programming and/or research
investigators select specific time frame during which data will be collected, then analyze after
Data collection methods: surveys, other instruments
Methodology:
investigators should describe case/control identification process
inclusion/exclusion criteria
data selection, collection, and collation process
Statistics
dependent on outcome of interest
Advantages: quick, less expensive
Disadvantages: transient effect (since data reflects specific period, challenging to know whether findings are by chance or ongoing), unable to determine cause and effect
Case Report/Case Series
Case Report: Report the clinical course of a particular patient
Clinical series: Report the clinical course of multiple patients linked by commonalities
Typically involves unique or unexpected observation, intervention, procedure, etc.
most reported: adverse events, birth defects
When there is insufficient supportive literature, serve to provide guidance and literature for other practitioners
No formal study design or presentation format
usually blending of introduction, background, and observation sections
Limited/no statistical analysis
use of data is restricted, limited ability to make population inferences or generalizations
may provide direction for future research
Intro to Drug Information: already in flashcards
Intro to the Library
Ethical & Legal Aspects of Drug Information
Copyright / Plagiarism / Citations
Introduction to Primary Literature
Research Methods
Intro to the Library
What do USF Health Libraries offer?
24/7 student study space
after hours access to Shimberg Library
Booking a study room or collaborative space
Access to computer lab and software
Copier, printing services, and poster printing
online access to journals and books off-campus
interlibrary loan services via lliad
library workshops
work with a librarian
Who has library building access?
USF faculty, staff, and students
all health faculty and students should automatically be added to the card permissions list upon registration for classes each semester
If you experience problems with card access, please visit WELL front desk or email usfhealthsss@heath.usf.edu
For quick questions, try email, chat, or knowledge base
For complicated questions, set up an appointment
To find books and journals, search the library catalog
General Reference books
AccessMedicine, AccessPharmacy, AccessSurgery
medical book titles, drug information, thousands of images, interactive self-assessments, case files, diagnostic tools, mobile app
LWW Health Library
medical education and pharmacy ebooks from Lippincott williams and Wilkins
Stat!Ref
Full-text cross-searachable reference books, includes Stedman’s Medical Dictionary, MedCalc3000, a unique computerized medical reference and tool set, and more
Thieme MedOne Education
over 110 e-textbooks covering entire medical school curriculum
Library Classes
Effective Searching and Databases Series
Writing and Publishing Series
Promotion and Tenure Series
Grants Series
Endnote
Effective Searching
Copyright/Plagiarism/Citations
What is copyright?
Copyright: form of protection by US law for original works of authorship (literary, dramatic, musical, artistic, etc)
Copyright protection exists as soon as work is fixed in tangible form (even a drawing on a napkin)
Lasts life of author + 70 years of exclusive rights to make copies, distribute, prepare derivatives, perform, and display publicly
Facts, names, short phrases, and methods are NOT protected by copyright (can be protected by patents)
Materials in public domain also not protected (copyright expired, forfeit, inapplicable)
Ex. Jane Austen’s pride and prejudice (expired)
Copyright can be given away or forfeit (creative common, cc zero., no rights reserved mark)
US federal government publications are in public domain
Works by third parties under government or state gov may be treated differently
How to use Copyrighted materials
Put a link to the material
Quote
Fair-use: allows others to use copyrighted material in specific scenarios
Depends on purpose and character of work, nature of original material, amount used of copyrighted material vs whole work, effect on original’s market
EX. Using short clip from film in documentary
Special exceptions to copyright
Libraries, schools, non-profits
Creative Commons licenses can tell what activities are allowed
Request permission from creator
Avoiding Plagiarism
Plagiarism: act of presenting another’s work or ideas as your own
“Kidnapping” someone else’s ideas
To avoid..
Directly quote material
When you cannot paraphrase or summarize without losing meaning
Can add credibility
Do not overuse (don’t parrot)
Paraphrase
Rewording in your own words
Summary
Integrates ideas
Shorter in length
Always cite!
Even professor’s lectures
Don’t cite when it is common knowledge or your own ideas
Something everyone would reasonably know (apples grow on trees, George Washington was president)
Start early, document sources as you go, and research well before starting to write to avoid plagiarism
Don’t copy and paste from original, don’t procrastinate!
Procrastination is biggest cause of plagiarism
Better to over-cite than take credit from someone else’s ideas
How to Cite Sources
When should you cite?
Did you think of it?
If not, cite
Is it common knowledge
If not common fact or saying, cite
Why should you cite?
Avoid plagiarism
Establish credibility
Help readers find the original materials
Citation style to use: AMA (also called JAMA)
Uses numbered endnotes that are placed in your text as superscript numbers with a References list at the end of the text in the order that the citation was used
Parts of a Citation
Authors
should list author’s surname followed by initials WITHOUT periods
For 1-2 authors: list all authors in reference list and in-text citations
For 3-6 authors: List all authors in reference list and 1st author followed by et al or “and colleagues” in-text citations
For 7+ authors: List first 3 authors followed by et al. in reference list, list 1st author followed by et al or “and colleagues” in-text citations
Article Title & Subtitle
use sentence capitalized (capitalize only first word and proper nouns, do not capitalize after colon)
Journal Title (abbreviated)
Capitalize all major words
Italicize titles
Find correct journal title abbreviations using National Library of Medicine Journals list
Year of publication/online pre-publication date
For published articles, YEAR followed by semi-colon
For articles online ahead of print/online journal, “Published online Month Date, Year” followed by period
If no volume, issue, or page numbers included, skip
If multiple dates, use MOST RECENT
Volume
issues collected into volumes, typically one year’s worth of issues
Year; Volume(issue):startpage-finalpage.
Issue
Each publication is an issue
Page range/e-locator
Should include the entire range of pages
DOI
Digital object identifier
unique permanent number given to each article (and other electronic resources)
if doi is shown within a URL, start with the 10.xx
if no DOI, use URL+access date
Introduction to Primary Literature
Classifications specific to pharmacy:
Primary: direct access to data
Secondary: abstracting or indexing search engines; facilitate location of primary and tertiary literature
Tertiary: indirect access to data; author interpretation of the literature
Primary Literature
Research methods
Evaluative (Experimental, Observational) or Descriptive
Identified via review of secondary and tertiary literature
Predominantly journal articles
Secondary Literature
indexing and abstracting services
index: citation only
abstract: citation plus description of article content
Facilitates search for tertiary and primary literature
Content varies per service
Tertiary Literature
Textbooks (general or specialty)
Compendia (computer databases)
Review articles
Evidence-based guidelines and consensus statements
package inserts
internet resources
Alternate/Unclassified Resources
Expert opinion
Pharmaceutical industry
Professional list servs
Primary Literature
Written accounts of original thought or discovery directly derived from first-hand observation or research
Introduces new evidence into the existing body of scientific knowledge
commonly published in medical or health-related journals
not all literature in journals is primary
not limited to journals
Examples of Primary Literature
Clinical research studies and reports (randomized controlled trials, cohort studies, case series, case reports)
Posters presenting original research
Sections of a Primary Literature Article
Title/Authors
Abstract
Overview of most important aspects of article
Allows reader to quickly determine if he/she wants to read entire article
Should not rely on abstract alone when reading
Introduction
Background info and rationale for research
study objectives
Methods
Describes how study was conducted
study design
patient selection/recruitment process
interventions used and process for use
how endpoints were measured
how data were collected
planned statistical analyses
Results
Description of data/findings
Statistical analysis of data
Discussion
Author’s interpretation of the results and the impact of the study
comparison to other studies
trial strengths and limiations
suggested directions for future research
Conclusion
summary of what authors feel is the ultimate impact of the study
References
Advantages and Disadvantages of Primary Literature
Advantages:
Original, current info
Detailed info
Open for reader’s own assessment of validity and applicability of study results
Disadvantages:
Conclusion based on one trail may eb misleading without context of other research
Reader must have good literature evaluation skills
Time-consuming
Costly and/or difficult to obtainIntro to Medical Journals
Types of medical journals:
General Focus
cover variety of disciplines and medical conditions
ex. New England Journal of Medicine, Journal of the American Medical Association
Specialty focus
covers specific medical conditions, organ systems, or patient populations
ex. Diabetes Care, Pediatric
Factors which increase reputability and credibility of journal
Peer Review
Editorial Board
Accept Correspondence
Affiliated with a professional organization
low advertisement to text ratio
Impact Factor
Average number of times the articles in a journal were cited during a period of time
Rating related to importance the scientific community places on articles published in a journal
higher impact factor = greater scientific influence
Research Methods
Categories of Research:
Evaluative
primary goal: answer a question
Experimental: measure interventions
Clinical trials
Meta-analysis
Pharmacoeconomic (PE)
Health Related Quality of Life (HRQoL)
Observational: examine specific data sources for the purpose of identifying relationships surrounding specific events or outcomes
Cohort
Case-Control
Cross-sectional/Survey
Article sections: Title, Authors, Abstract, Introduction/background, Methods, Results, Discussion, Conclusion, References
Descriptive
primary goal is to report individual experiences
typically lack hypothesis or scientific principles
findings often lead to the development of evaluative studies
Cohort, Case-control, cross-sectional, case-report/clinical series,
Overlap with observational research!
Article sections: Title, Authors, Abstract, Introduction/background, Observations (combo of methods and results), Discussion, Conclusion, References
Section Content Overview
Introduction/Background
Literature review
Study objective and hypothesis
Methods, statistics, and results are inter-related
Methods determine type of results, collected data determines statistical analysis
Results should follow methods and address all planned analysis
Discussion: interpret results (no new data/findings), relate to existing literature, address limitations and future research
Methodolgy
Sample Description
Demographics
Size
Inclusion/Exclusion criteria
Blinding
Single: participants unaware of intervention allocation
Double: Both participants and researchers unaware of intervention allocation
Open-label: No blinding
Control group(s)
Placebo: physically identical to intervention, no therapeutic effect
Active: comparable treatment given
seek equivalency, inferiority, or superiority regarding desired effect
Administration of intervention
Parallel: concurrent administration
Crossover: Participant serves as their own control
receive both interventions with washout period in-between
Allocation of intervention
randomized: computerized process that generates allocations without patterns
nonrandomized or random allocation: process that has no randomization or utilizes a distinct pattern
Number of sites
single: one physical location/organization
multiple: broad, more diverse practice or several organizations
impact patient factors and ability to generalize results to other populations
Outcomes (ECHO)
Economic
evaluation of costs and associated consequences
cost effectiveness, cost-benefit, cost-utility, cost-minimization
Costs
Direct:
Medical: monies spent on healthcare
Non-medical: monies spent while obtaining healthcare (ex. time off work, transportation)
Indirect:
Monies lost secondary to morbidity
Monies lost secondary to mortality (death)
Intangible
Related to disease or treatment
Value attributed to pain, suffering, and/or distress
Clinical
Biologic and physiologic changes
Lab findings, physical findings
Usually focus on events
disease-related, drug-related, other interventions
Humanistic
Effect an intervention has on an individual
Health-related quality of life
Satisfaction
Functional status
Physical, Psychological, Social
Symptoms associated with a disease or treatment
Cultural or ethnicity-related beliefs
Measurement Domains
Instruments: questionnaire or survey
General: health profiles, utility analyses
Disease-specific
Administration: self or investigator
Operational
Assessment of how perceptions or behaviors changed (operationally) as a result of an intervention
impact and implications
Utility
Many perspectives considered (patient, provider, payer, society)
Clinical practice (formulary management, clinical practice guidelines, justification of services/programs)
Pharmaceutical industry (drug development, pricing)
Clinical Trials
Purpose: to evaluate cause and effect
Design: true experiment or quasi-experimental
quasi-experimental: groups are not randomly assigned
Prospective
Involve some type of intervention
laboratory; animal or human
Pharmaco-
Therapeutic: medication, procedure, physiologic manipulation, behavioral
Kinetic: absorption, distribution, metabolism, elimination
Dynamic: pathophysiologic
Methodology
Key components: Sample, Blinding, Control group(s), administration parameters, intervention allocation, number of sites, outcome variables
Analysis
predominantly inferential: dealing with data sets
set a priori (before study begins)
based on type of data (nominal, ordinal, interval/ratio)
usually includes alpha value (p-value)
reflects type one error (false positives) to support when to accept or reject the null hypothesis
traditional level of significance is <0.05
may include beta value (power)
reflects type two error (false negative) or ability to detect differences between groups
used to determine appropriate number of participants in each allocation arm
Advantages: best way to measure cause and effect
Disadvantages: time intensive, expensive, may be unethical
Meta-Analysis
Study of studies
Does not directly involve patients, an outcome, or intervention
combination and statistical analysis of results from previously conducted studies (clinical trials, cohort, case-control)
WILL develop hypothesis
Similar to a review article in approach but findings are substantiated by the determination of statistical relationships
By combining data (increasing participants), relationships may be better appreciated
Method section will include:
Search strategy description
detailed description of strategy used to identify studies
typically entails both computerized and manual efforts (tertiary lit, secondary lit, alternate resources)
Article review process description
Description of reviewers
minimum 2
evaluate and rank articles based on a comparison of method sections
blinded to author, title, publication source, and results
Inclusion/Exclusion Criteria
determined a priori
description of required methodologies and data extraction process
description of excluded studies will be listed within the text of the document or table
Data collation
aka pooling: combining results from included studies
prior to pooling, investigators will perform statistical analyses to ensure homogeneity
Statistical data classification
Nominal: comparing effects not participants
Variants of chi-square
Results usually presented as odds ratios with 95% confidence intervals
Additional analyses
sensitivity analysis: performed to see whether inclusion of different variables influences circumstances
logistic regression: clarify magnitude of significance when confounding variables
Advantages: If results from individual trails are inconclusive or conflicting, meta-analysis can further evaluate previously identified associations, enhance power, and provide direction for future research initiatives
subground analysis, post hoc analysis
Disadvantages: Retrospective, publication bias (if investigators can only find published studies), internal validity (identified relationships will not be pure), will not confirm cause/effect
Cohort Analyses
Purpose: to determine the relationship between risk factor exposure and outcome(s)
evaluate risk
goal: establish causation (not as pure as relationship determined by clinical trial)
determine incidence
Investigators should have some suspicions that the relationship is possible
Findings from literature used to support hypothesis
Usually prospective, may begin with a retrospective review before moving forward
Obtain pre-determined baseline information
Methodology:
select a duration of follow-up that is long enough to realize outcome of interest
tend to be very long
enroll a sufficient number of patients (power)
power analysis performed so investigators know number of patients required before study begins
Many cohorts include cases (exposed), controls (not exposed)
Comparable groups to include in cohort should have similar:
Demographics
Prior healthcare
Monitoring parameters within trial (physical examination, labs, procedures)
standardized methods
equal access
similar evaluation time frames
Historians: recall bias
inability to recall can introduce bias
Compliance
can be difficult because of longitudinal nature of cohorts, some may drop-out, withdraw
Statistics:
Relative Risk
A measure of the risk of a certain event happening in one group compared to the risk of the same event happening in another group
1 = identical risk (reference value)
<1 = lower risk
>1 = higher risk
Confidence intervals
used to quantify magnitude of relationship
wider confidence interval = more likely relationship is due to chance
confidence intervals that include 0 are null/void
Attributable risk
evaluating incidence vs. outcomes
statistics differentiate causation from chance occurrence
Advantages: investigators determine sample characteristics, evaluation parameters/techniques
Disadvantages: May require long duration of follow-up depending on outcome, may be expensive, difficulties may arise with maintaining controlled factors, dropout rates increasing with time, membership bias (difficult to determine whether outcome is secondary to risk factor or to group characteristics), surveillance bias (circumstances associated with investigation affect outcome
Case Control Analyses
opposite of Cohort
Purpose: to determine which prior risk factor may be contributing to an observed outcome
evaluate risk
establish causation
examine prevalence
Retrospective; often used to determine the need for prospective analyses
Methodology:
Before study is undertaken, investigators determine suspected risk factors for an outcome
must be literature support/evidence
Cases and controls identified by the investigators are matched
Cases: with outcome
Controls: without outcome
Must be comparable groups (demographics, access to healthcare, recall ability should be good)
key determinant: how well groups are matched
Methods should include description of matching process in regard to Beta or power
Common for mismatch between case number vs controls (number of controls may be much higher than cases)
Investigators retrospectively review records and perform interviews to determine risk factor exposure
both groups may or may not have risk factor exposure
Individuals involved with data extraction/interviews are blinded to study intent and patient circumstances to avoid deviation and reduce bias
protocols developed to insure appropriate and accurate data collection
Predetermine inclusion/exclusion criteria, suspected risk factors, definition of exposure, criteria and statistical methods used to determine existence of relationships
avoid data mining
Statistics
Odds ratios or variance
The OR represents the odds that an outcome will occur given a particular exposure, compared to the odds of the outcome occurring in the absence of that exposure
1 = identical odds
<1 = lower odds
>1 = higher odds
Confidence intervals (95%)
used to quantify magnitude of relationship
Regression analysis
further quantify relationship between different variables
identify best fit line to describe relationship between data points
more linear = more likely relationship
direction =.postive or negative relationship
Advantages: investigating rare diseases, evaluating diseases that develop/progress slowly, investigating ethically sensitive issues, less expensive, quicker to perform, able to identify multiple risk factor associations
Disadvantages: rely on accuracy/completeness of database, risk factor and outcome data collected simultaneously makes identifying relationships challenging, recall/surveillance bias, protopathic bias (making the appropriate risk factor to outcome correlations
Cross-sectional analysis
purpose: to evaluate an outcome (opinions, environmental circumstances, disease states, or interventions) at a single, specified period in order to determine prevalence and develop ideas for future programming and/or research
investigators select specific time frame during which data will be collected, then analyze after
Data collection methods: surveys, other instruments
Methodology:
investigators should describe case/control identification process
inclusion/exclusion criteria
data selection, collection, and collation process
Statistics
dependent on outcome of interest
Advantages: quick, less expensive
Disadvantages: transient effect (since data reflects specific period, challenging to know whether findings are by chance or ongoing), unable to determine cause and effect
Case Report/Case Series
Case Report: Report the clinical course of a particular patient
Clinical series: Report the clinical course of multiple patients linked by commonalities
Typically involves unique or unexpected observation, intervention, procedure, etc.
most reported: adverse events, birth defects
When there is insufficient supportive literature, serve to provide guidance and literature for other practitioners
No formal study design or presentation format
usually blending of introduction, background, and observation sections
Limited/no statistical analysis
use of data is restricted, limited ability to make population inferences or generalizations
may provide direction for future research