MATH 1_unlocked

Page 1: Data Management

What is Data?

  • Data: Raw information or facts that become useful when organized meaningfully.

  • Can be qualitative (descriptive) or quantitative (numerical).

What is Data Management?

  • Data Management: The process concerned with "looking after" and processing data.

  • Involves:

    • Looking after field data sheets

    • Checking and correcting raw data

    • Preparing data for analysis

    • Documenting and archiving data and metadata

Importance of Data Management

  • Ensures high-quality data for analysis, leading to correct conclusions.

  • Enables further use of the data in future studies and facilitates integration of results.

  • Leads to improved data processing efficiency, quality, and meaningfulness.

Planning and Conducting an Experiment or Study

Methods of Data Collection
  1. Census: Sir systematic acquisition and recording of information from all members of a population.

    • Rarely used due to high costs and dynamic populations.

  2. Sample Survey: Selection of a subset within a population to gain insights about the whole.

    • Advantages:

      • Lower cost

      • Faster data collection

      • Improved accuracy due to smaller datasets.

  3. Experiment: Conducted under controlled variables to study effects.

    • Requires replication to validate results.

  4. Observation Study: No controlled variables; relies on surveys for data collection.

    • Example: Examining smoking's correlation with lung cancer.

Planning and Conducting Surveys
  1. Characteristics of a Good Survey:

    • Must represent a population.

    • Incorporates randomness (e.g., random number generator).

    • Neutral question wording to avoid biases.

    • Control for potential errors and biases.

  2. Sampling Methods:

    • Nonprobability Sampling:

      • No chance of selection for some elements; reliant on non-random criteria (e.g., convenience sampling).

      • Example: Interviewing the first person to answer the door on a street.

    • Probability Sampling:

      • All elements can be selected; probability can be determined.

      • Types:

        • Simple Random Sampling: Equal selection probability. Vulnerable to sampling error.

        • Systematic Sampling: Selects elements at fixed intervals; less prone to bias, but sensitive to list order.

        • Stratified Sampling: Divides population by categories to ensure representation.

        • Cluster Sampling: Selects clusters randomly; can reduce costs but increase variability.

        • Matched Random Sampling: Pairs matched by researchers to control for variables.

Page 2: Planning and Conducting Surveys Continued

Nonprobability Sampling

  • Issues arise from biases and errors since some individuals are excluded from selection.

  • Example: Convenience sampling in supermarkets can be biased towards those who respond.

Probability Sampling

  • Enables accurate estimation of sampling errors.

Types of Probability Sampling
  1. Simple Random Sampling (SRS): Selections are independent; works well for homogeneous populations but can misrepresent population makeup.

  2. Systematic Sampling: Randomly selects elements from evenly spaced intervals, risks periodic bias based on list structure.

  3. Stratified Sampling: Ensures representation of subgroups within the larger population, enhances accuracy when variability between strata is high.

  4. Cluster Sampling: Cost-effective; risks bias if clusters are not representative.

  5. Matched Random Sampling: Controls for variables by pairing participants based on specified traits.

Page 3: Planning and Conducting Experiments

Characteristics of a Well-Designed Experiment

  • Clearly define research purpose and treatment comparisons.

  • Use design techniques like blocking and randomization.

  • Analyze data for future hypotheses and document results.

  • Example: The Hawthorne Effect illustrated that behavior changed due to observation rather than conditions.

Control Groups and Experimental Design

  • Comparing effects requires control groups; treatment groups receive specific conditions, while controls do not.

  • Random Assignment: Ensures treatment effects are evenly distributed across groups.

  • Replication: Reduces variability; findings must be repeatable by others for validation.

Bias and Confounding Variables

  • Confounding: Extraneous variables can lead to incorrect conclusions.

    • Example: Correlation between ice cream sales and drownings due to summer.

  • Placebo Effect and Blinding: Placebos can falsely improve conditions; subjects aren't aware of treatment reception to reduce bias.

Page 4: Experimental Design Types

Types of Experimental Designs

  1. Completely Randomized Design: Focuses solely on one primary factor; treatments assigned randomly without considering other variables.

  2. Randomized Block Design: Uses blocks of similar subjects to reduce variability affecting results.

  3. Matched Pairs Design: Special case of randomized block design with pairs sharing similar attributes.

Page 5: Chi-Square Tests

Chi-Square Test Overview

  • Used to determine discrepancies between expected and observed frequencies.

  • Two types:

    1. Goodness of Fit Test: Tests sample frequency distribution against expected distribution based on theory.

    2. Test of Independence: Assesses if two categorical variables are independent.

Assumptions of the Chi-Square Test

  • Requires random sampling and independence of observations.

  • Expected counts should be no less than five.

Goodness of Fit Test Step-by-Step

  1. Calculate observed frequencies.

  2. Establish expected frequencies (minimum 5).

  3. Conduct hypothesis tests (null vs. alternative hypotheses regarding frequencies).

Page 6: Goodness of Fit Test Example

  • Researchers survey coffee drinkers against previous studies.

  • Statistical calculation and decision criteria defined.

  • Chi-square statistic is derived to draw conclusions about data alignment with expectations.

Page 7: Test of Independence

Using the Chi-Square Test of Independence

  • Aims to find relationships between two factors, not the strength or nature of that relationship.

  • Formulate hypotheses for the association test, ensuring expected counts meet the minimum requirement.

Example Scenario

  • Random sample of treatments for musculoskeletal pain; expected frequencies are calculated, followed by hypothesis tests to analyze independence.

Page 8: Example of Day of Birth Frequencies

Testing Frequencies of Births by Day

  • A doctor hypothesizes equal proportions of births across days.

  • A Chi-Square test is performed following steps similar to goodness-of-fit to validate assumptions regarding frequencies.

Conclusion

  • Statistical evidence is used to confirm or reject null hypotheses regarding population distributions.