W10 ppn - rigour qualitative methodology trustworthiness

trustworthiness and integrity in qualitative research

• we have to judge the quality of data that were collected (rigour)

• process used are completely different from quantitative research and reflect in the language

• not usually see words - reliability and validity in qualitative but rather credibility, confirmability, dependability, transferability, authenticity

what is credibility

• accuracy ,validity,soundness of data

• confidence in truth of findings

what is confirmability (auditability)

• auditability -charcteristics of qualitative study devleoped by investigtors research process;allows another researcher or reader to follow the thinking or conclusions of the investigation

• confirmability - dedgree of neutrality or extent to which study findings shaped by respondent and not researchers bias, motivation, interest

  • ql researchers keeps detailed notes as to where data came from , how data was interpreted and findings obtained, etc, so readers cna trace data to their sources

whats dependability

• readers cna follow how researchers made decisions by evaluating adequacy of the analysis

• showing that findings are consistent and could be repeated

whats transferability (fittingness)

• degree to which study findings are applicable to outside the study situation and degree to which results are mengingful to individuals not invovled in research

• findings from one study/context can be transferred to another that is similar in context/participants

• knowledge transferred from one context to another

whats authenticity

• fairness in presentation in that all value conflicts, differences and views of participants are noted in analysis

how to know if data is trust worth

• •Credibility:

  • •Member checking

  • •Peer debriefing (also referred to as peer review)

  • •Prolonged Engagement/Persistent Observation

  • •Negative case analysis/Deviant case analysis

• •Confirmability

  • •Triangulation*

  • •Audit trail

  • •Reflexivity

• •Dependability

  • •Inquiry audit

• •Transferability

  • •Thick description

• •Authenticity

  • * Guba and Lincoln see triangulation as part of confirmability – many others see it as belonging under credibility.

credibility techniques - member checking

• data, analytic categories, interpretations adn concllusions tested with members of those groups from who data were originally obtained

• informmaly or formally - opportunities for member checks may arise during normal course of observation adn conservation

• lincoln and guba - most crucial for establishing credibility - but controversial

credibility techniques - peer debriefing (peer review)

• process exposing ones self to disinterested peer in a manner parallelling an analytical session and for the purpose of exploring aspects of the inquiry that might other wise remain only implicit withing the inquirers mind

credibility techniques - prolonged engagement/ persistent observation

• spending sufficient time in the field to learn or understand the culture, social setting or phenomenon fo interrest

• spending adequat time observing various aspects of setting, spekaing with a range of people, developing relationships and rapport with members of culture

• development of rapport/trust facilities understanding and co construction of meaning between researhcer and memebers of a setting

• prolonged engagement provides scope - persistent observation = depth

credibility techniques - negative case analysis (deviant case analysis)

• searching and discussing elements of the data that dont support or appear to contradict patterns or explanations that are emerging form data anylsis

• deviant case analysis - process for refining analysis until cna explain or account majority cases

• analysis ofdeviant case may revise , broaden and confirm patterns emerging from data analysis

confirmability techniques - triangulation

See: http://www.qualres.org/HomeTria-3692.html

Denzin (1978) and Patton (1999) identify four types of triangulation:

•Methods triangulation - checking out consistency of findings generated by different data collection methods. 

•Triangulation of sources - examining consistency of different data sources from within the same method.  For example:

•Analyst Triangulation - using multiple analyst to review findings or using multiple observers and analysts

•Theory/perspective triangulation - using multiple theoretical perspectives to examine and interpret the data

confirmability techniques - audit trail

See: http://www.qualres.org/HomeAudi-3700.html

•Transparent description of research steps taken from the start of a research project to development and reporting of findings.  Records are kept regarding what was done in an investigation.

Lincoln and Guba (1985, p. 319-310) cite Halpern's (1983) categories for reporting information when develop an audit trail:

•Raw data 

•Data reduction and analysis products 

•Data reconstruction and synthesis products 

•Process notes 

•Materials relating to intentions and dispositions 

•Instrument development information

confirmability techniques - reflexivity

See: http://www.qualres.org/HomeRefl-3703.html

•Attitude of attending systematically to the context of knowledge construction, especially to the effect of the researcher, at every step of the research process. 

•"A researcher's background and position will affect what they choose to investigate, the angle of investigation, the methods judged most adequate for this purpose, the findings considered most appropriate, and the framing and communication of conclusions" (Malterud, 2001, p. 483-484).

•Perspective or position of researcher shapes all research - quantitative, qualitative, even laboratory science.

dependability techniques - inquiry audit

See: http://www.qualres.org/HomeExte-3704.html

•External audits involve having a researcher not involved in the research process examine both the process and product of the research study. 

•Purpose is to evaluate accuracy and evaluate whether or not findings, interpretations and conclusions are supported by the data.

transferability techaniques - thick descriptions

See: http://www.qualres.org/HomeThic-3697.html

•By describing a phenomenon in sufficient detail, can begin to evaluate extent to which conclusions drawn are transferable to other times, settings, situations, and people.

authenticity techniques - authenticity

•Guba & Lincoln (1989) later suggested that the researcher must also authenticate the data by:

•Ensuring those who participated in the research have been able to understand the world they live in and their human condition through the research (ontological).

•Being fair to participants, considering their social worlds helps gain their acceptance.  On-going informed consent is required.

•Increasing level of understanding that participants have for others (educative)

•Enhancing decision making abilities (catalytic)

•Participants being empowered through the research (tactical)