Quantitative Qualitative and Mixed Research Methodologies

Research Leadership: This lecture material was compiled by Dr. A. Singh for Research Skills ( $RESK401$ ) and Project $3A$ ( $PRJA301$ ).
Academic Programs: The content is designed for students enrolled in the Advanced Diploma in ICT ( $ADICT1$ ) or the B.ICT Degree ( $BINCT1$ ).
Fundamental Distinction: Research strategies belong to one of two primary possibilities: quantitative or qualitative. The differences between these two are particularly pronounced when determining how data will be collected, how it will be analysed, and the nature of the eventual result.
The Researcher's Responsibility: The researcher must be acutely aware of fundamental differences between methodologies to make an intelligent choice for the research design and ensure research objectives are achieved.
Decision Factors: The primary factors driving the choice between electing quantitative or qualitative research are the research aim and the specific nature of the research question.
Methodology in Information Technology (IT): In the IT field, quantitative research is the most frequent choice. This prevalence is attributed to the common application types, design-oriented research, and a lower dependency on collecting data directly from human subjects.

Quantitative Research Definition: Quantitative research is defined as explaining phenomena by collecting numerical data that are analysed using mathematically based methods, specifically statistics. It involves the collection of numerical data that is subsequently analysed using mathematical formulas or statistics. The results are grounded in the functional proof of the chosen research methods.
Qualitative Research Definition: Qualitative research seeks to answer questions regarding why and how people behave in specific ways. According to Skillsyouneed ( $2021$ ), it provides in-depth information regarding human behavior. It does not rely on numerical data, but rather focuses on perceptions, opinions, and observations to seek answers for why and how things exist or occur.

Purpose of Quantitative Research:
- Usually aims to test or confirm established theories or assumptions.
- Numerical data is transformed into statistics that quantify defined variables under investigation.
- Results in generalizable facts that can be extrapolated from a specific sample to a much larger population.
Purpose of Qualitative Research:
- Aims to conduct deep investigations and gather in-depth insights into topics that are not currently well understood.
- Generally exploratory in nature.
- Attempts to understand underlying reasons, opinions, and motivations.

Quantitative Data Collection:
- Data is numerical and utilized to measure variables.
- The nature of the data is structured and statistical.
- Results are characterized as being objective and conclusive.
- Sources of data include experiments, surveys, and secondary data (such as Integrated Tertiary Software or ITS reports regarding student assessment marks).
- Techniques include closed-ended questions.
Qualitative Data Collection:
- Data is non-numerical and unstructured.
- The goal is to describe a topic rather than measure it.
- Data is typically collected in a natural setting, usually without simulations or experiments.
- Techniques include focus groups, interviews, case studies, expert opinions, open-ended surveys, and observations.

Quantitative Case Study Example:
- Scenario: A survey involving $300$ $1^{st}$ year IT students.
- Question Type: Students are asked questions such as: "on a scale from $1-5$ , how satisfied are you with provisioned computer laboratories?"
- Analytic Process: Statistical analysis is performed on the data.
- Result: A conclusion might state: "on average students rated computer laboratories at $4.4$ ".
Qualitative Case Study Example:
- Scenario: Conducting in-depth interviews with $15$ $1^{st}$ year IT students.
- Question Type: Open-ended questions such as: "How satisfied are you with provisioned IT labs?", "What is the most positive aspect of the IT labs?", and "What can be done to improve the IT labs?"
- Analytic Process: Characterized by transcribing responses, coding data, and identifying specific patterns and trends.

Determining the Approach: For most research, either approach can potentially be used; the choice is dictated by the nature of the research.
Rule-of-Thumb (Scribbr, $2021$ ):
- Use Quantitative research to confirm or test something (such as a theory or hypothesis).
- Use Qualitative research to understand something (such as concepts, thoughts, or experiences).
Combined Approaches: Some research may combine both data types. For instance, a survey may utilize precise closed-ended questions but include an open-ended question at the end (e.g., "Should you have any other comments regarding the IT Labs please write them here"). This captures any missed responses or nuances.

Focus:
- Quantitative: Focuses on testing theories and hypotheses.
- Qualitative: Focuses on exploring ideas and formulating a theory or hypothesis.
Analysis:
- Quantitative: Analysed through math and statistical analysis.
- Qualitative: Analysed by summarizing, categorizing, and interpreting.
Expression:
- Quantitative: Mainly expressed in numbers, graphs, and tables.
- Qualitative: Mainly expressed in words.
Sample Size:
- Quantitative: Requires many respondents.
- Qualitative: Requires few respondents.
Questions:
- Quantitative: Closed (multiple choice) questions.
- Qualitative: Open-ended questions.
Key Terminology:
- Quantitative Keywords: Testing, measurement, objectivity, replicability.
- Qualitative Keywords: Understanding, context, complexity, subjectivity.

Definition: Mixed research is a combination of both qualitative and quantitative approaches.
The Process of Integration: It typically involves data collected in unstructured, qualitative formats (interviews, social media, video, sound clips, or open-ended questions). This data is then transcribed or pre-processed into a numerical format.
Example of Pre-processing: Categorical data pertaining to race groups (Indian, White, Black, Coloured, Other) can be transcribed into a structured numerical format where: $\text{Indian} = 1$ , $\text{White} = 2$ , $\text{Black} = 3$ , $\text{Coloured} = 4$ , and $\text{Other} = 5$ .
Outcome: Once pre-processed, statistical or mathematical analysis techniques can be applied. Mixed research provides scientific rigour to the analysis of qualitative data.

Conceptual Questions:
- 1. What is the difference between quantitative and qualitative research?
- 2. Briefly describe ‐mixed-method‐ research.
- 3. Write a research question for a quantitative study.
- 4. Write a research question for a qualitative study.
- 5. Apart from the techniques listed in the lecture note, write down another two each for quantitative and qualitative data collection.
Case Study Classification (Study Aims): Identify if the following are qualitative or quantitative:
- a. Developing a random forest model for Long-term follow-up of patients with chronic myeloid leukaemia.
- b. A crash sensor array to reduce road accident fatalities.
- c. Developing a student centred CX university portal.
- d. Identifying the challenges of Agile adoption in small IT solutions organizations.
- e. Building the first bio-fluid CPU.