research week 10

Strategies for Rigor and
Trustworthiness in Qualitative
Research

No universal agreement on what makes

qualitative research “high quality.”

Different Perspectives on Rigor:

• Constructivists: Fear rigid criteria may limit

creativity.

• Pragmatists: Value standards but accept

they are evolving.

• Critics: Worry lack of uniform standards

reduces credibility.

Evaluative Criteria & External Standards in Qualitative

Research

Guba & Lincoln (1985) proposed trustworthiness criteria for qualitative

studies:

• Credibility → accuracy of researcher’s interpretations with

participants’ views

• Transferability → applicability of findings to other contexts

• Dependability (Auditability) → clear, traceable research procedures

• Confirmability → findings are grounded in data, not researcher bias

It offers qualitative alternatives to quantitative standards like validity and

reliability

Attending to Rigor & Trustworthiness in Qualitative

Research

Rigor is not strict rules:

• Traditional ideas of rigor (rigidity, replication) clash with rich, human-

centered qualitative research

• Focus on flexibility, context, and depth rather than fixed outcomes

Why standard criteria don’t fit:

• Internal validity, reliability, replication → unsuitable for changing contexts

and subjective meanings

Trustworthiness (Guba & Lincoln, 1989):

• Research is fair, ethical, and accurately reflects participants’ experiences

• Must be demonstrated through careful documentation and evidence

Source: Padgett, 2017.

Generalizability in Qualitative Research

Not a main goal: Qualitative studies focus on depth, context, and

meaning, not statistical generalization.

• Transferability > Generalizability: Readers judge whether findings

apply to other settings or situations.

Different “levels” of generalization (Maxwell, 2002):

• Local: apply findings to similar participants in the same study

• Broader: apply concepts or patterns to other contexts or

populations

Ecological validity matters: Detailed context allows readers to make

their own judgments about applicability.

Threats to Trustworthiness in Qualitative Research

Three main threats:

1. Reactivity – Participants’ behavior or responses may change because of the

researcher’s presence; threatens ecological validity.

2. Researcher Bias – Personal opinions, assumptions, or emotions can influence:

• Choice of participants

• Questions asked

• Interpretation of data

• Reflexivity (self-awareness) helps reduce this.

3. Respondent Bias – Participants may:

• Withhold or alter information

• Misremember events

• Give socially desirable answers

• Sensitive issues may require careful timing and trust-building

Strategies for Rigor in Qualitative Research

Qualitative research is often misunderstood: Small samples and

flexible methods can raise doubts.

• Explain your methods: Include a rationale in your proposal to justify

why qualitative methods are appropriate—this educates readers and

shows mastery.

• Rigor is active, not just explained: Beyond justification, specific

strategies are used during the study to enhance trustworthiness.

• Six key strategies exist in the literature, each addressing threats such

as reactivity, researcher bias, and respondent bias (discussed in the

next few slides).

Six Strategies for Rigor in Qualitative Research

.Prolonged Engagement

1. Spend extended time with participants to build trust, reduce reactivity, and

gather rich, credible data.

2.Triangulation

1. Use multiple data sources, methods, theories, disciplines, or analysts to enhance

completeness and reduce bias.

3.Peer Debriefing and Support (PDS)

1. Discuss findings and interpretations with peers or mentors to challenge

assumptions and maintain reflexivity.

4.Member Checking

1. Verify interpretations and findings with participants to ensure their perspectives

are accurately represented.

5.Negative Case Analysis

1. Examine data that contradicts initial interpretations to refine conclusions and

avoid one-sided findings.

6.Auditing (Audit Trail)

1. Document all steps of data collection and analysis to allow transparency and

accountability in the research process.

1. Prolonged Engagement in Qualitative Research

Prolonged Engagement means spending extended time in the field to build

trust and understanding.

Benefits:

• Reduces reactivity – participants act more naturally over time.

• Reduces respondent bias – less chance of withholding or altering

information.

• Builds trusting relationships, helping the researcher notice

inconsistencies.

Considerations:

• Multiple encounters or interviews are useful when long-term

engagement isn’t possible.

• Risk of researcher bias – becoming too close (“going native”) or overly

familiar.

• Reflexivity helps maintain balance.

Properly managed, prolonged engagement strengthens rigor and

Source: Padgett, 2017.

2. Triangulation of Data

The term triangulation, borrowed from navigational science and land

surveying, originally referred to using two or more sources to achieve a

comprehensive picture of a fixed point of reference. Four types of

triangulation were outlined by Denzin (1978):

• Theory triangulation: The use of multiple theories or perspectives to

interpret a single set of data

• Methodological triangulation: The use of multiple methods to study a

single topic

• Observer triangulation: The use of more than one observer in a single

study to achieve intersubjective agreement

• Data triangulation: The use of more than o

3. Peer Debriefing & Support (PDS) in Qualitative

Research

PDS means regular meetings with peers or mentors to review data, discuss challenges,

and reflect on the research process.

Purpose:

• Enhance rigor by reducing researcher bias

• Provide fresh perspectives and constructive feedback

• Support reflexivity and ethical research practices

Benefits:

• Helps novice researchers navigate fieldwork

• Encourages sharing coding, field notes, and interpretations

• Offers practical tips and emotional support

Best practices:

• Meet regularly; rotate leadership

• Can be homogeneous (same discipline) or heterogeneous (multiple disciplines)

• Can include online meetings if needed

When done well, PDS is a powerful tool for enhancing trustworthiness and researcher

accountability. Source: Padgett, 2017.

4. . Member Checking in Qualitative Research

Member checking means going back to participants to verify or reflect on

preliminary findings.

Purpose:

• Reduce researcher bias

• Extend collaborative relationship between researcher and participants

• Engages participants in co-constructing meaning

• Support reflexivity and credibility of interpretations

Considerations:

• Can generate new insights or interpretations

• May not be feasible for all studies, but reflects qualitative values of

engagement and meaning-making

Member checking is a useful but complex strategy to enhance rigor and

trustworthiness in qualitative research.

5. Negative Case Analysis in Qualitative Research

Negative Case Analysis means actively looking for cases or data that contradict

preliminary findings or assumptions.

Purpose:

• Enhances trustworthiness by challenging biased or one-sided

interpretations

• Encourages critical self-reflection by the researcher

• Helps identify exceptions that refine or confirm the study’s conclusions

Process:

• Requires careful, repeated review of data

• Often involves deductive thinking, especially in grounded theory

Negative case analysis strengthens rigor by ensuring findings are credible

6. Auditing & Leaving a Decision Trail in Qualitative

Research

It involves documenting the steps of data collection and analysis to maintain

transparency and accountability.

Components:

• Raw (de-identified) data

• Memos and field notes

• Iterative/evolving codebooks or thematic analysis plans

Purpose:

• Increases trustworthiness by showing how decisions were made in research

process

• Allows others (mentors, PDS groups) to follow the researcher’s reasoning

Considerations:

• Can be time-consuming and add workload

• Some researchers feel it intrudes on creativity or privacy

Keeping an audit trail is a practical way to enhance accountability and transparencySource: Padgett, 2017.

Applying Strategies for Rigor Across Qualitative

Approaches

Fit depends on research type:

• Ethnography: Prolonged engagement is central; member checking

and data triangulation also work well.

• Case study, Grounded theory, Action research: Any strategy can

apply; case studies favor data triangulation, grounded theory favors

negative case analysis.

• Narrative research: Data triangulation and negative case analysis are

less relevant.

• Phenomenology: Member checking and prolonged engagement fit;

peer debriefing and auditing may interfere with capturing deep

meaning.

Applying Strategies for Rigor Across Qualitative

Approaches

Example: Morrow & Smith (1995) used all six strategies in grounded theory with sex

abuse survivors:

1. Multiple interviews & prolonged engagement

2. Weekly peer debriefing meetings

3. Triangulated data via interviews, focus groups, documents, and journals

4. Member checking with participants as co-researchers

5. Audit trail via detailed memos and coding

6. Negative case analysis for disconfirming evidence

Paradigm matters:

• Constructivist studies value prolonged engagement most

• Audit trails, negative case analysis, and triangulation as corroboration may not fit

multiple realities

• Strategies must align with research paradigm to enhance rigor effectively

Rigor in Action-Oriented & Community-Based

Research

CBPR and action research share control with community members, emphasizing

relevance and collaboration.

Challenge: Balancing rigor (methodological thoroughness) with relevance (community

priorities)

• Community members may lack research expertise or resist strict protocols

• Researchers face tension between career-driven rigor and community needs

Recommendations:

• Dedicate time and patience to build trust and collaboration

• Avoid overly rigid or experimental designs early; start with engagement

• Plan for flexibility; quick studies risk compromising rigor

Appraising Quality: Checklists, Criteria, and Guidelines

Why they emerged:

• Increase in qualitative studies submitted for publication and funding

• Need for systematic reviews and meta-syntheses to compare studies

Examples of standards:

Consolidated Criteria for Reporting Qualitative Studies -COREQ (Tong et al.,

2007): 32 items in 3 domains

• Researcher characteristics & reflexivity

• Study design & participant selection

• Analysis & reporting of findings

Cohen & Crabtree (2008): 7 evaluative criteria

Ethics, importance, clarity, appropriate methods, reflexivity, credibility, reliability

Appraising Quality: Checklists, Criteria, and Guidelines

Charmaz’s (2014) 19 Criteria for Quality in Constructivist Grounded Theory

Charmaz proposes 19 criteria grouped into four categories: credibility, originality,

resonance, and usefulness

Credibility

Appraising Quality: Checklists, Criteria, and Guidelines

Charmaz’s (2014) 19 Criteria for Quality in Constructivist Grounded Theory

Charmaz proposes 19 criteria grouped into four categories: credibility, originality,

resonance, and usefulness.

Source: Padgett, 2017.

Credibility

1. Intimate familiarity with the research

setting and topic

2. Sufficient and rich data

3. Systematic comparisons during analysis

4. Development of wide-ranging categories

5. Logical links between data, analysis, and

findings

6. Claims supported by sufficient evidence

Resonance

1. Categories capture the full experience

of participants

12. Attention to hidden or unstable

meanings

13. Links between broader social

institutions and individual lives (when

relevant)

14. Findings make sense to participants

Originality

7. Fresh categories and insights

8. New conceptual interpretations

9. Social and theoretical significance

10. Findings that challenge, extend, or

refine existing ideas and practices

Usefulness

15. Interpretations are useful in real-life

contexts

16. Categories identify broader social

processes

17. These processes are examined for

deeper or implicit meanings

18. Findings stimulate further research

Balancing Rigor and Relevance: The “Big Tent” Approach

Relevance:

• Qualitative research matters when it connects to real-world issues

• Especially in social work: inequality, exclusion, disempowerment

• Findings resonate with audiences beyond academia: policy makers, agencies, media

Tracy’s (2010) Eight “Big Tent” Criteria:

• Worthy topic – addresses important questions (“so what?”)

• Rich rigor – theory use, sufficient and appropriate data

• Sincerity – transparency and reflexivity

• Credibility – triangulation, thick description, member reflection

• Resonance – evocative and transferable findings

• Significant contribution – new theory, method, or practical impact

• Ethics – protect participants, monitor, exit respectfully

• Meaningful coherence – connects literature, questions, findings, and interpretations

Integration with Rigor Strategies

Triangulation, member checking, prolonged engagement → credibility

• Peer debriefing → supports rigor and transparency

• Audit trail → promotes sincerity

• Negative case analysis → less visible but aligned

Practical Implications:

• Include criteria in study design and planning

• Document what actually happened → ensures transparency

• Publishing “behind-the-scenes” accounts supports reflexivity and guides

others

The “Big Tent” balances methodological rigor with practical relevance, making

qualitative research meaningful and impactful.

Enhancing Rigor in Qualitative Research with

Underrepresented Rural African American Communities

Key Points

Participant-Centered Data Collection

• Rigor depends on “data-rich” findings, allowing participants to tell their stories fully.

• Requires prolonged engagement, respect for community customs, and time to build

trust.

Time and Community Engagement

• Research is time-intensive due to travel, geographic isolation, and relationship

building.

• Trust may depend on transparency about researcher connections to the community.

Capturing Community Diversity

• Rural African American communities are heterogeneous (age, gender, education,

religion, location).

• Low research participation often occurs because communities have not been asked,

not due to negative experiences.

Enhancing Rigor in Qualitative Research with Underrepresented Rural African

American Communities

Key Points (Cont’d)

Strategies to Enhance Rigor

• Diverse research team (race, gender, education) including members of the target

community.

• Negative case analysis—consider unusual or contradictory data rather than excluding

it.

Member Checking

• Traditional transcript review may be impractical.

• Alternative approaches: checking interpretations during interviews or follow-up focus

groups.

Intercoder Reliability

• Useful when multiple coders collaborate on interpretation.

• Not always appropriate, as strict agreement may reduce interpretive richness and

creativity in qualitative research.

Achieving rigor requires trust-building, cultural sensitivity, methodological flexibility, and

collaborative interpretation, especially when working with underrepresented communities.

Source: Hamilton, 2020