Scientific Data Analysis: Data Manipulation, Descriptive Statistics, and Distributional Exploration
Software Environment, Data Organization, and Spreadsheet Operations
Structured File and Directory Management:
Standard scientific workflow requires dedicated, hierarchical directory structures on cloud storage (e.g., OneDrive) separated by course unit and individual instructional topics (e.g.,
Topic 1).Weekly datasets must be retrieved directly from the repository environment and stored locally within corresponding topic directories to maintain data integrity.
Spreadsheet Menu Architecture:
Standard spreadsheet applications structure tools across a horizontal top ribbon organized into functional tabs:
File: Document management, saving, importing, and exporting.
Home: Formatting, cell styling, clipboard operations, and basic data manipulation tools (including Sort & Filter).
Insert: Insertion of tables, visual displays (charts, histograms, scatter plots), and specialized symbols.
Formulas: Function libraries, formula auditing, calculation options, and defined names.
Data: External data connections, data queries, advanced sorting, filtering, and data validation.
Help: Integrated documentation, function reference guides, and software support.
Syntax and Execution of Essential Summary Functions:
Formulae are inputted directly into the function bar preceding data sheets and require an initial equals sign (
=) followed by the operator and targeted cell range arguments:: Calculates the total number of cells in a specified range containing numerical values. Empty cells or cells containing text strings are excluded. Full column references, such as ` , evaluate all numerical rows while ignoring header labels.: Computes the additive total of all numerical values within a designated block (e.g.,adds rows through in Column C) or an entire column (e.g.,).: Determines the arithmetic mean of all numeric values across a specified array (e.g.,).: Tallies the number of cells within an evaluated range that satisfy an exact logical criterion or string match. String criteria require double quotation marks (e.g.,), as do relational mathematical comparisons (e.g.,).: Returns the largest mathematical value within a series, ignoring text headers automatically (e.g.,identifies the absolute maximum in Column C, whileevaluates strictly rows to of Column D).: Calculates how often values occur within specific numerical intervals (bins), returning a vertical array of counts.
Spreadsheet Manipulation Techniques:
Column Insertion and Dynamic Indexing: Inserting a new column shifts existing columns to the right. Dynamic sequential numbering (e.g., creating an identifier column
ID) is executed by typing the initial values (, ) in consecutive rows, selecting both cells, and using the autofill handle (bottom right-hand corner of the active cell box) to drag downward.Data Sorting and Selection Expansion: When sorting a single column of interest, adjacent records within the same table must maintain row-level integrity. If a single column is highlighted and sorted via Home > Sort & Filter > Sort Smallest to Largest, the software detects adjacent values and initiates a Sort Warning dialog box.


The user must select Expand the selection rather than Continue with the current selection; choosing the former reorders entire horizontal rows simultaneously based on the sorted column, preventing records from becoming mismatched.
Data Classification, Structure, and In-Class Collection
Core Statistical Terminology:
Observational Unit: The individual entity, subject, or object on which measurements are collected (e.g., an individual student, an oyster specimen, or a specific bird roosting location).
Variable: Any characteristic, attribute, or quantity recorded for an observational unit that varies from one entity to another.
Taxonomy of Data Types:
Qualitative (Categorical) Data: Variables that describe qualities, attributes, or categories rather than measurable quantities:
Nominal Data: Categories with no natural, objective ranking or order (e.g., Eye colour: blue, brown, green, grey; Hair colour: black, blonde, brown).
Ordinal Data: Categories that have a logical hierarchy, sequence, or relative scale, but lack uniform mathematical distances between categories (e.g., Size ratings: Small, Medium, Large).
Quantitative (Numerical) Data: Variables that represent measurable, numerical counts or physical quantities:
Discrete Data: Numerical values resulting from counting processes, taking on distinct, separate values (often integers) with no intermediate fractions possible (e.g., Number of siblings: ).
Continuous Data: Numerical values resulting from physical measurements along an uninterrupted continuum, capable of taking any real value within a given interval depending on measurement precision (e.g., Handspan in , Height in , Oyster volume in , Weight in , Shoe size).
In-Class Biometric Dataset Structure:
Biometric measurements recorded across students define observational units and variables:
ID: Nominal integer identifier distinguishing individual students.Eye colour: Qualitative nominal variable.Hair colour: Qualitative nominal variable.Siblings: Quantitative discrete variable.Shoe size: Quantitative numerical variable.Handspan: Quantitative continuous variable (measured in using standardized calibration tools such ashttps://www.ginifab.com/feeds/cm_to_inch/actual_size_ruler.html).Height: Quantitative continuous variable (measured in ).

Observed Sample Records ( Subsample of Class):
ID : Eye colour =
brown, Hair colour =brown, Siblings = , Shoe size = , Handspan = , Height =ID : Eye colour =
blue, Hair colour =brown, Siblings = , Shoe size = , Handspan = , Height =ID : Eye colour =
blue, Hair colour =blonde, Siblings = , Shoe size = , Handspan = , Height =ID : Eye colour =
blue, Hair colour =blonde, Siblings = , Shoe size = , Handspan = , Height =ID : Eye colour =
green, Hair colour =brown, Siblings = , Shoe size = , Handspan = , Height =ID : Eye colour =
blue, Hair colour =brown, Siblings = , Shoe size = , Handspan = , Height =ID : Eye colour =
blue, Hair colour =blonde, Siblings = , Shoe size = , Handspan = , Height =ID : Eye colour =
brown, Hair colour =black, Siblings = , Shoe size = , Handspan = , Height =ID : Eye colour =
brown, Hair colour =brown, Siblings = , Shoe size = , Handspan = , Height =ID : Eye colour =
blue, Hair colour =brown, Siblings = , Shoe size = , Handspan = , Height =Summary Statistics for Full Class Cohort ():
Siblings: Mean = , Standard Error = , Median = , Mode = , Standard Deviation = , Sample Variance = , Kurtosis = , Skewness = , Range = , Minimum = , Maximum = , Sum = , Count = .
Shoe size: Mean = , Standard Error = , Median = , Mode = , Standard Deviation = , Sample Variance = , Kurtosis = , Skewness = , Range = , Minimum = , Maximum = , Sum = , Count = .
(): Mean = , Standard Error = , Median = , Mode = , Standard Deviation = , Sample Variance = , Kurtosis = , Skewness = , Range = , Minimum = , Maximum = , Sum = , Count = .
Height (): Mean = , Standard Error = , Median = , Mode = , Standard Deviation = , Sample Variance = , Kurtosis = , Skewness = , Range = , Minimum = , Maximum = , Sum = , Count = .
Experimental Calibration and Computer Vision: The Oyster Dataset
Study Origin and Experimental Context:
Collected in 2001 at an R&D laboratory at AGRI-TECH Inc. in Woodstock, Virginia.
Published in Three-dimension Reconstruction for High-speed Volume Measurement, Proceedings of the International Society for Optical Engineering (2001).
Designed as a calibration experiment to estimate the volumetric size of oysters and evaluate/compare two computer vision imaging technologies (2-D area-based imaging versus 3-D volumetric reconstruction) for automated size classification based on pixel counts.
Variable Architecture:
Oyster_ID: Unique numerical identification code for each specimen.Oyster_Weight_g: Mass of the specimen measured in grams ().Oyster_Volume_cc: True physical volume of the specimen measured in cubic centimeters ().Pixels_3D: Size metric obtained from the 3-D imaging system, quantified in volume pixels (voxels).Pixels_2D: Size metric obtained from the 2-D computer vision system, quantified in pixel area.
Classification Rules and Semi-Automated Categorization:
Commercial classification bins oysters into three ordinal grades based on volume ():
Small:
Medium:
Large:
Procedural workflow in Excel:
Sort records by
Oyster_Volume_cc(Column C) ascending, using selection expansion.Label Column F as
Size.Populate cell
F2with"Small"for rows where volume is .Click and hold the fill handle at the bottom-right corner of cell
F2and drag downward to row to propagate the classification across all qualifying records.

* Repeat labeling for `"Medium"` and `"Large"` intervals, verifying counts using ``.
Bivariate Graphical Modeling (Scatter Plots):
Implemented by highlighting paired numerical columns (e.g., Column C
Oyster_Volume_ccand Column DPixels_3D) and navigating to Insert > Charts > All Charts > X Y (Scatter).Flipping Plot Axes: If variables are plotted on incorrect coordinates, right-click inside the plot area, click Select Data, and modify the cell ranges assigned to X values and Y values within the dialog box, updating the series name to match the corrected dependent variable.
Visual Tools for Categorical Data
Overview of Visual Tools by Data Type:
Categorical Data: Pie charts, Bar charts, Pareto charts.
Numerical Data: Frequency histograms, Frequency polygons, Cumulative frequency polygons (ogives), Box-and-whisker plots (boxplots).
Pie Charts (Proportional Composition):
Represents proportional or percentage breakdowns of a single categorical variable, where the entire circle equals .
Observed distribution of student eye colours ( total observations):
Blue: students ()
Brown: students ()
Green: students ()
Grey: student ()

Observed species counts in butterfly population sampling:
Coenonympha tullia:
Glaucopsyche lygdamus:
Ochlodes sylvanoides:
Plebejus icarioides:
Papilio zelicaon:
Bar Charts (Frequency Comparison):
Displays counts or relative frequencies across discrete, non-overlapping categories with distinct spaces between bars (indicating absence of continuity).
Student hair colour observations demonstrate categories organized along the horizontal axis (
Black,Blonde,Brown) against absolute frequency on the vertical scale.Pareto Charts (Quality Control and Ranked Analysis):
Developed by Italian economist Vilfredo Pareto; standardly employed in industrial engineering and quality management to isolate the "vital few" causes of process defects.
Dual-Axis Architecture:
Primary vertical axis (left): Ranks categories in descending order of absolute frequency (tallest bar on the left to shortest bar on the right).
Secondary vertical axis (right): Displays a continuous cumulative percentage line starting at the top of the first category and terminating at exactly .
Readily adapted to ecological and scientific analysis to distinguish dominant observational groupings.

Measures of Central Tendency
Mean ():
The arithmetic average, calculated by dividing the sum of all numerical values by the sample size ():
Most mathematically powerful measure of centre when data is symmetric and bell-shaped.
Highly sensitive to extreme values or distribution skewness, particularly in small samples, pulling the calculated center toward the extreme tail.
Median:
The physical middle observation of a dataset after sorting all values in ascending order.
Positional calculation depending on sample size ():
If is odd: The middle value situated at rank .
If is even: The arithmetic average of the two central values located at ranks and .
Resistant to outliers and extreme skewness; widely preferred for heavily skewed socioeconomic indicators such as individual income or suburban house prices.
Mode:
The most frequently occurring score, value, or category within a dataset.
Operates across both numerical and categorical data types (unlike mean or median).
A dataset can possess no mode, a single mode (unimodal), two distinct modes (bimodal), or multiple modes (multimodal).
Measures of Dispersion and the Garden Worm Study
The Biological Benchmark Study:
Derived from Introduction to Statistics for Biology (Trudy A. Watt, Robin H. McCleery, Tom Hart).
Evaluates physical body lengths of common garden earthworms to establish standard analytical protocols.
Sample Measurements ( Backyard Worms, in ):
Unordered array:
Ordered array:

Histogram Visual Variation:
Bin width directly affects the visual perception of numerical distributions: the same dataset of worms yields different histogram profiles depending on chosen interval boundaries (e.g., bins
[6, 9.5],(9.5, 13],(13, 16.5]).
Central Tendency Calculations for Worm Sample:
Mean:
Median: For , average the () and () ranked values:
Mode: The single score repeated most frequently is (frequency = ).
Measures of Dispersion (Spread):
Range: The mathematical distance between the absolute maximum and minimum values:
* Highly simplistic; measures the total boundaries of of observations without revealing the internal concentration of intermediate values.
Interquartile Range (): The difference between the third quartile (, percentile) and the first quartile (, percentile), measuring the spread of the central of ordered data:
Lower half values ( lowest observations): . Median () = .
Upper half values ( highest observations): . Median () = .
Calculation:
* *Note:* Standard automated spreadsheet summary packages (such as Excel's *Descriptive Statistics* tool) do not include in their standard summary output.
Sample Variance () and Sample Standard Deviation ():
Quantifies dispersion relative to the arithmetic mean, penalizing scores that deviate substantially from the center.

Standard mathematical formulation for sample standard deviation:
Manual Computation Matrix (, ):
Score : Deviation , Squared Deviation
Score : Deviation , Squared Deviation
Score : Deviation , Squared Deviation
Score : Deviation , Squared Deviation
Score : Deviation , Squared Deviation
Score : Deviation , Squared Deviation
Score : Deviation , Squared Deviation
Score : Deviation , Squared Deviation
Score : Deviation , Squared Deviation
Score : Deviation , Squared Deviation
Sum of Deviations:
Sum of Squared Deviations:
Variance and Deviation Solutions:
Comprehensive Output Table (Descriptive Statistics for Worm Length):
Mean =
Standard Error =
Median =
Mode =
Standard Deviation =
Sample Variance =
Kurtosis =
Skewness =
Range =
Minimum =
Maximum =
Sum =
Count =

Sample Size Invariance of Standard Deviation:
Standard deviation estimates the underlying population spread. When random samples of different sizes (, , ) are repeatedly drawn from the same stable biological population, the calculated sample standard deviation remains approximately identical across samples, whereas sample sums and counts scale proportionally with sample size.
Distributional Shape, Outlier Detection, and Ogives
Morphology of Distribution Curves (Measures of Shape):
Skewness describes distribution asymmetry across a frequency histogram, polygon, or boxplot relative to where the majority of observations concentrate.

Symmetric Distribution (Zero Skew):
Unimodal, classic bell-shaped profile (approximately normal distribution).
Observations concentrate evenly around the central axis, with values tapering identically into left and right tails.
Mean, median, and mode coincide at the same point:
* Typical biological examples: Heights and weights of university students.
Positive Skew (Right-Hand Skew):
The bulk of data values cluster at the lower end of the measurement scale, while a small number of extremely high observations extend the tail toward the right.
Mathematical ordering of central tendency metrics:
* Typical real-world example: Age distribution of undergraduate university students.
Negative Skew (Left-Hand Skew):
The majority of data values cluster at the upper end of the measurement scale, while rare, exceptionally low values extend the tail toward the left.
Mathematical ordering of central tendency metrics:
* Typical real-world example: Academic grade distributions in competitive university courses.
Definite determination of skewness cannot be established reliably from tiny samples due to potential multimodality; large representative samples are necessary to identify true population shape.
Detection and Methodological Treatment of Statistical Outliers:
Outliers are atypical measurements that diverge markedly from the overarching pattern of the data.
Outliers do not necessarily denote erroneous measurements; they must first be validated against data collection protocols to determine whether they represent transcription errors, equipment malfunctions, or genuine natural extremes.
In standard visual exploration, box-and-whisker plots display outliers as discrete plotted points located beyond the outer fences (whiskers).
Statistical practice frequently computes dual evaluations: once with the complete dataset and once with verified outliers removed, evaluating the structural robustness of the reported parameters.
Cumulative Frequency Polygons (Ogives):
Graph of running cumulative totals or cumulative percentages plotted against upper interval boundaries.
In an earthworm sample of size , converting absolute cumulative counts to relative cumulative percentages ( to ) standardizes data to evaluate percentiles regardless of total sample size.
Systematic Case Study: Carnaby's Black Cockatoo
Ecological Background:
Field survey assessing roosting site preferences and flock sizes of the endangered Carnaby's Black Cockatoo (Calyptorhynchus latirostris) across Western Australia.
Categorical Analysis of Roosting Substrates:
Sunset monitoring of roosting events categorized by tree type and urban setting:
Urban Pine (
UrbPine): sites ()Urban Eucalyptus (
UrbEuca): sites ()Non-Urban Pine (
NonUrbPine): sites ()Non-Urban Eucalyptus (
NonUrbEuca): sites ()Total Observations () =

Pareto Ranking Construction:
First ranked:
UrbPine(, Cumulative = )Second ranked:
UrbEuca(, Cumulative = )Third ranked:
NonUrbPine(, Cumulative = )Fourth ranked:
NonUrbEuca(, Cumulative = )Quantitative Roosting Flock Size Survey ( Complete Dataset):
Raw Sunset Counts:
Binned Frequency Distribution ():
Bin : Frequency = , Cumulative Frequency =
Bin : Frequency = , Cumulative Frequency =
Bin : Frequency = , Cumulative Frequency =
Bin : Frequency = , Cumulative Frequency =
Bin : Frequency = , Cumulative Frequency =
Bin : Frequency = , Cumulative Frequency =
Bin : Frequency = , Cumulative Frequency =
Bin : Frequency = , Cumulative Frequency =

Outlier Removal and Comparative Sensitivity Analysis:
Inspection of the boxplot identifies three distinct high-value statistical outliers situated above the upper whisker: , , and .
Removing these three extreme observations reduces the cohort to , modifying the highest frequency intervals (bin drops from to ; bins and drop to ).

Direct Comparison of Descriptive Parameters:
Sample Size (): (With Outliers) vs. (Without Outliers)
Mean (): (With Outliers) vs. (Without Outliers) — shifted downward by units ( reduction).
Median: (With Outliers) vs. (Without Outliers) — minimal shift of units, illustrating resistance to extreme values.
Mode: (With Outliers) vs. (Without Outliers) — entirely unaffected.
Range: () vs. () — reduced by units ( reduction).
Interquartile Range (): vs. — shifts by only unit, demonstrating stability of the central core.
Standard Deviation (): vs. — contracted by units ( decrease), reflecting reduced dispersion.
Sample Variance (): vs. — reduced by units.
Kurtosis: vs. — drops toward baseline normal peakedness as outlier tails are removed.
Skewness: vs. — shifts from marked positive right skew toward an approximately symmetric profile.
Minimum Value: vs.
Maximum Value: vs.
Sum: vs.
Real-World Applications: Property Market Economics
Skewness and Parameter Selection in Real Estate:
Housing markets typically display strong positive skewness caused by high-end property transactions, rendering arithmetic mean values misleadingly elevated.
Non-parametric positional measures (medians and quartiles) provide reliable representations of market conditions.

Longitudinal Real Estate Analysis (Scarborough Market, 2016–2020):
Annual settled sales metrics (evaluated 1 April 2019 to 31 March 2020, settled as at 03 August 2020):
Upper Quartile ():
Median ():
Lower Quartile ():
Contextual metric: Metropolitan Perth overall median remained substantially below local Scarborough values, ranging near

Long-Term Longitudinal Shift (Settled Sales as at 25 July 2024):
Re-evaluation of market parameters demonstrates marked capital appreciation and expansion of the interquartile range:
Upper Quartile (): (, percentile)
Median (): (, percentile)
Lower Quartile (): (, percentile)
Interquartile Range Expansion:
The increase in indicates broader price divergence across middle-tier properties alongside rising median valuations.