Mixed Method Research Notes

Mixed Method Research

Research Instruments

Common instruments in mixed methods research include:

  • Questionnaires: Can be closed-ended (quantitative data) or open-ended (qualitative data). Closed-ended are easier to analyze, while open-ended can provide greater depth.
  • Interviews: Can be person-to-person or group. Different types exist, ranging from informal to structured. Semi-structured interviews are often preferred for their flexibility.
  • Classroom Observations: Provide firsthand data and can be combined with questionnaires and interviews for triangulation. Can be participant or nonparticipant.

Questionnaires

Advantages:

  • Efficient for large-scale data collection.
  • Cost- and time-efficient.
  • Anonymity encourages honest responses.
  • Closed-ended are easily analyzed.

Disadvantages:

  • Potential for inaccurate answers.
  • Low return rates.
  • Ambiguity can lead to irrelevant responses.
  • Wording can influence responses.

Administration Methods:

  • Self-administered: Mailed out; low return rate, potential for misunderstandings.
  • Group-administered: Given to groups; higher return rate, researcher can clarify questions.

Interviews

Strengths:

  • Good for measuring attitudes.
  • Allow probing and in-depth information.
  • Good interpretative validity
  • Relatively high response rates often attainable.

Weaknesses

  • In-person interviews expensive and time-consuming.
  • Perceived anonymity by respondents possibly low.
  • Data analysis sometimes time-consuming for open-ended items.

Interview Types:

  • Informal conversation: Questions emerge naturally.
  • Interview guide approach: Topics specified, but reworded as needed.
  • Structured open-ended: Predetermined questions in a fixed order.
  • Closed, fixed response: Similar to closed-ended questionnaire.

Classroom Observations

Strengths:

  • Firsthand picture of events.
  • Natural setting.
  • Contextual factors can be obtained.

Weaknesses:

  • Time-consuming analysis.
  • Difficult to observe large populations.
  • Potential for observer bias and reactivity.

Observation Methods:

  • Nonparticipant: Observer remains aloof.
  • Participant: Observer integrates with the students.

Validity

Validity concerns the believability and truthfulness of the research.

Types of Validity:

  • Content Validity: Determined by experts in field; unclear questions are revised and ineffective questions discarded.
  • Internal Validity: Congruence of findings with reality. Methods to boost include triangulation, member checks, long-term observation, peer examination, participatory modes, and addressing researcher bias.
  • External Validity: Applicability of findings to other settings/subjects.
  • Utility Criterion: Usefulness of the evaluation findings for stakeholders.

Reliability

Reliability deals with the consistency and dependability of the research.

Techniques to Ensure Dependability:

  • Investigator’s position: Explicit explanation of inquiry processes.
  • Triangulation: Use of different data collection procedures and sources.
  • Audit trail: Detailed description of data collection and analysis.

Types of Reliability:

  • External Reliability: Replication of the study by independent researcher.
  • Internal Reliability: Consistency of data collection, analysis, and interpretation.

Reporting the Study

  • Report outcomes clearly to the relevant audience.
  • Compare and contrast outcomes with existing theories and literature.
  • Consider the social and political context.
  • Report findings based on pre-agreed goals and objectives.