TW1 E6: Documenting the Methods Section

Methods section

• Describes the planned date collection and analysis procedures.

• Answers “what will you do?”

Methods section

• Demonstrates the integrity of the research process.

• Helps readers figured out how to replicate the study.

• Outlines what it will be like for the participants.

Introductory Statement, Research Factors, Research Design, Subjects and Sampling, Instruments, Data Gathering Procedure, Ethical Considerations, Statistical Treatment

What are the 8 parts of the Methods Section (Chapter 2)?

Factor

• The subject matter or object of investigation of any research endeavor as with an experiment.

• Has 3 labels of different designs:

  • Research Variables - For Quantitative and Mixed-Methods

  • No section for Qualitative

Factors in Comparative Studies

• Describe the attribute variable (personal characteristics) that are used as bases for the comparison (e.g., age, sex, ethnicity, location, company position).

• Describe the measured variable(s) that you will be comparing the scores of (e.g., stress, depression, etc.).

Factors in Survey Studies

• Describe the specific factors of interest studied in the research.

• Since there are no comparison, causal, or correlational analyses meant to be undertaken, the research objects are simply referred to as “factors.”

Factors in Experimental Studies

• Describe the independent variable(s) or the condition(s) which are hypothesized to have an effect on the dependent variable(s) (e.g., presence of authority, teaching style, etc.).

• Describe the measured variables commonly taken in pre/post-testing scenarios (e.g., stress, depression, etc.).

Correlation variables

Factors in Correlation, Moderation, Mediation, and Predictive Studies

Term used for Correlation

Predictor and outcome

Factors in Correlation, Moderation, Mediation, and Predictive Studies

Term used for Predictive Studies

Moderator/mediator, dependent, and independent variables

Factors in Correlation, Moderation, Mediation, and Predictive Studies

Term used for Moderation/Mediation

Conceptual definition

• Lexical definition inferred from sources.

  • Ex. “Adversity quotient refers to the collective ability of students to deal with and solve the problems that they experience (Fadhila, Mudjiran, & Gistituati, 2019).”

Operational definition

• Definition is achieved by way of specificity, measurement, or indicator.

• Ex. “Adversity quotient is an individual’s ability to handle setbacks measured by the Adversity Quotient (AQ) scale (Stoltz, 1997).

Simple Random Sampling, Stratified Random Sampling, Cluster Sampling, Systematic Sampling, Convenience Sampling, Purposive Sampling, Snowball Sampling, Quota Sampling

What are the 8 sampling methods?

Simple Random Sampling

Sampling Methods

• Pure randomization of the selection of participants.

Stratified Random Sampling

Sampling Methods

• Sampling technique wherein you divide participants according to groups, or strata, based on specific criteria/characteristics, and select a few individuals per group.

Cluster Sampling

Sampling Methods

• Sampling technique wherein you divide participants according to clusters and select everyone within the cluster.

Systematic Sampling

Sampling Methods

• Sampling technique wherein you select an interval by which to systematically select participants.

Convenience Sampling

Sampling Methods

Sampling technique wherein you select participants purely because of convenience to you, primarily due to location (e.g., sampling UST students because you’re studying in UST).

Purposive Sampling

Sampling Methods

• Sampling technique wherein you select participants based on a set criteria.

Snowball Sampling

Sampling Methods

• Sampling technique wherein you select participants by asking for recommendations or referrals to other participants after each person, hence it will snowball (think rolling a snowball to make it bigger).

Quota Sampling

Sampling Methods

• Sampling technique wherein you select participants by choosing an arbitrary number and will continue to recruit participants until said number is met.

Inclusion Criteria

• Defined characteristics or requisites that will enable them to be fully accommodated as study participants.

• Clearly defined, attestable through records or other modes of verification.

Inclusion Criteria

There should be no room for vagueness here as it could confound the results of your study (e.g., only saying “women” but not saying if trans women are included).

Exclusion Criteria

• Any ground that may disqualify prospective participants from taking part in the study.

• Commonly, but not necessarily, the negation or the opposite of the inclusion criteria.

Exclusion Criteria

• Exclusions must be justifiable and aligned with the purpose of the study.

• Ex. Must not be involved in a romantic relationship, “situationship,” or union during the time of the actual conduct of the research

300

Sampling from a Population

Acceptable practice of having _____ and up for sample size (quantitative research).

5 to 25

Sampling from a Population

Look for sources based on your qualitative study (e.g., Cresswell recommends ______ for phenomenological studies).

low statistical power

Sampling from a Population

A lower sample size means…

Data saturation (qualitative)

Sampling from a Population

No new themes or findings are emerging through the data collection process.

Instruments

• Must be valid and reliable

• Permission for educational use

• Short and uses universal language

• Has proper scoring and interpretation instructions

Pilot Testing

• Ideally used in the Philippines

• Administering the test to a few of the target sample.

• Validated by SMEs.

John Colaizzi, Amedeo Giorgi, Van Kaam

What are the 3 common coding methods?

John Colaizzi

Common Coding Methods

• Entails validation by study collaborators or participants.

Amadeo Giorgi

Common Coding Methods

• Capitalizes on the inherent knowledge of the researchers themselves to process data.

Van Kaam

Common Coding Methods

• Requires that external judges be involved in validating the emerged insights as researchers have not experienced the phenomenon.