Scientific Measurements, Precision, and Significant Digits Study Guide

Uncertainty and the Nature of Scientific Measurements

There are two primary types of quantities utilized in scientific practice: exact values and measurements.
Exact Values: These consist of defined quantities and counted values.
- Defined quantities are established by standard units (e.g., $1\,m = 100\,cm$ ).
- Counted values represent discrete whole items (e.g., $5\,\text{beakers}$ or $10\,\text{trials}$ ).
Measurements: Unlike exact values, measurements are never perfectly exact. There is an inherent degree of uncertainty associated with every scientific measurement.
Due to this variability, there is a globally recognized international agreement regarding the standard methods for recording and communicating measurements.

Precision in Measuring Instruments

Measurements are limited by the precision of the specific instrument used and the depth of information that instrument provides.
Definition of Precision: The precision of an instrument corresponds to the specific place value of the final measurable digit.
Precision is numerically indicated by the count of decimal places in a measured or calculated value.
- Example: The precision of $4.628\,cm$ is evaluated as $3$ because it contains three decimal places.
- A higher number of decimal places denotes greater precision. For instance, $2.861\,cm$ is considered more precise than $2.86\,cm$ .
Instrument Calibration: Precision is determined by the "degree of fineness" and the unit size.
- Example: A ruler calibrated in millimeters (referred to as Ruler #2) is inherently more precise than a ruler calibrated in centimeters (Ruler #1) because Ruler #2 possesses a greater frequency of graduations.

Principles of Estimating and Recording Measurements

Standard practice mandates that an observer should always attempt to read an instrument by estimating to the nearest tenths of the smallest marked division.
Uncertain Digits: Any measurement value that falls between the smallest marked divisions of an instrument is an estimate. Consequently, the final digit recorded in any measurement is considered an "uncertain digit."
- Example: In the recorded measurement of $87.65\,cm$ , the uncertainty resides in the final digit ( $5$ ).
The estimated digit must always be included when recording a measurement.
Direct Alignment: If an object aligns perfectly with a marked division, the estimated digit is recorded as $0$ .
- Example: If an object is measured with a millimeter-calibrated ruler and aligns exactly with the $5.2\,cm$ mark, the correct reading to record is $5.20\,cm$ .

Significant Digits (Certainty in Communication)

The degree of certainty in a measurement is communicated through the total number of significant digits.
Significant Digits comprise all digits known with absolute reliability plus the single final digit that is estimated (uncertain).

Rules for Determining Significant Digits

Non-zero Digits: All digits from $1$ to $9$ are significant.
- $259.69$ contains $5$ significant digits.
- $61.2$ contains $3$ significant digits.
Captive Zeros: Any zeros located between two non-zero digits are significant.
- $606$ contains $3$ significant digits.
- $6006$ contains $4$ significant digits.
Trailing Zeros with Decimals: Zeros to the right of both a non-zero digit and a decimal point are significant.
- $7.100$ contains $4$ significant digits.
- $7.00$ contains $3$ significant digits.
Scientific Notation: Every digit (zero or non-zero) included in the mantissa of scientific notation is significant.
- $3.4 \times 10^3$ contains $2$ significant digits.
- $3.400 \times 10^3$ contains $4$ significant digits.
Counted and Defined Values: These possess an infinite ( $\infty$ ) number of significant digits as they are exact.
- $16\,\text{students}$ has $\infty$ significant digits.
- $\pi = 3.1415...$ has $\infty$ significant digits.

Rules for Non-Significant Digits (Placeholders)

Leading Zeros: If a decimal point is present, zeros appearing to the left of the first non-zero digit are not significant; they serve exclusively as placeholders.
- $0.35$ contains $2$ significant digits.
- $0.00042$ contains $2$ significant digits.
Trailing Zeros without Decimals: If no decimal point is visible, zeros to the right of the final non-zero digit are not significant.
- $98,000,000$ contains $2$ significant digits.
- $25,600$ contains $3$ significant digits.

Practical Examples: Identifying and Representing Significant Digits

Identification (Example 1)

(a) $353\,g$ : $3$ significant digits
(b) $9.663\,L$ : $4$ significant digits
(c) $76,600,000\,g$ : $3$ significant digits
(d) $30.405\,ml$ : $5$ significant digits
(e) $0.3\,MW$ : $1$ significant digit
(f) $0.000067\,s$ : $2$ significant digits
(g) $10.00\,m$ : $4$ significant digits
(h) $47.2\,m$ : $3$ significant digits
(i) $2.7 \times 10^5\,s$ : $2$ significant digits
(j) $3.400 \times 10^{-2}\,m$ : $4$ significant digits

Scientific Notation Conversion (Example 2)

(a) $865.7\,cm \rightarrow 8.657 \times 10^2\,cm$
(b) $35,000\,s \rightarrow 3.5 \times 10^4\,s$ ( $2$ sig digs)
(c) $0.050\,kg \rightarrow 5.0 \times 10^{-2}\,kg$
(d) $40.070\,nm \rightarrow 4.0070 \times 10^1\,nm$
(e) $0.000060\,ns \rightarrow 6.0 \times 10^{-5}\,ns$

Standard and Advanced Rounding Rules

Rule for Lower Digits: If the first digit to be dropped is $4$ or less, the last retained digit remains unchanged.
- Example: $3.141326$ rounded to $4$ digits is $3.141$ .
Rule for Higher Digits: If the first digit to be dropped is greater than $5$ , or if it is a $5$ followed by any non-zero digit, increase the last retained digit by $1$ .
- Example: $2.221372$ rounded to $5$ digits is $2.2214$ .
- Example: $4.168501$ rounded to $4$ digits is $4.169$ .

Special Case: The Even-Odd Rule

When the first digit to be discarded is exactly $5$ (followed only by zeros or nothing), use the following logic to minimize rounding bias:

If the last retained digit is odd, increase it by $1$ .
If the last retained digit is even, do not change it.
Examples:
- $2.35 \rightarrow 2.4$ (to two digits; $3$ is odd)
- $7.185 \rightarrow 7.18$ (to three digits; $8$ is even)
- $-6.350 \rightarrow -6.4$ (to two digits; $3$ is odd)
- $9.12500 \rightarrow 9.12$ (to three digits; $2$ is even)

Measurement Calculations and Operation Rules

Rules for Addition and Subtraction

The final result must have the same number of decimal places as the measurement in the set with the fewest decimal places.
Example: $6.6\,m + 18.74\,m + 0.766\,m = 26.106\,m$ .
- Limitation: The measurement $6.6\,m$ limits precision to the tenths place.
- Rounded Final Answer: $26.1\,m$ .

Rules for Multiplication and Division

The final result must have the same number of significant digits as the measurement with the fewest significant digits in the set.
Example: $7.78\,m/s \times 0.8967\,s = 6.976326\,m$ .
- Limitation: $7.78$ has three significant digits.
- Rounded Final Answer: $6.98\,m$ .
- This rule also applies strictly to values in scientific notation.

Rules for Multistep and Mixed Calculations

Multistep Logic: To avoid cumulative round-off errors, do not round intermediate results. Retain all digits in the calculator until the final step is reached, then round only the conclusive result.
Mixed Operations: In calculations involving a combination of addition, subtraction, multiplication, and division, the general rule for multiplication and division (fewest significant digits) should be followed for the final rounding.

Calculation Practice and Operations

Summary Table (Example 3 Samples)

Measurement	Sig Digs	Precision	Needed Sig Digs	Rounded Value	Sci. Notation
$63.479\,km$	$5$	$3$	$3$	$63.5\,km$	$6.35 \times 10^1\,km$
$46,597.2\,cm$	$6$	$1$	$2$	$47,000\,cm$	$4.7 \times 10^4\,cm$
$0.5803\,L$	$4$	$4$	$1$	$0.6\,L$	$6.0 \times 10^{-1}\,L$
$325\,kg$	$3$	$0$	$2$	$320\,kg$	$3.2 \times 10^2\,kg$
$0.06780\,mm$	$4$	$5$	$3$	$0.0678\,mm$	$6.78 \times 10^{-2}\,mm$
$485.000\,kW$	$6$	$3$	$4$	$485.0\,kW$	$4.850 \times 10^2\,kW$

Mathematical Operations (Example 5)

(a) $67.8 + 968 + 3.87$ : Result based on fewest decimal places ( $0$ decimals for $968$ ).
(b) $463.66 + 29.2 + 0.17$ : Result based on fewest decimal places ( $1$ decimal for $29.2$ ).
(c) $68.7 - 23.95$ : Result based on fewest decimal places ( $1$ decimal for $68.7$ ).
(d) $(2.6)(42.2)$ : Result based on fewest sig digs ( $2$ sig digs for $2.6$ ).
(e) $(65)(0.041)(325)$ : Result based on fewest sig digs ( $2$ sig digs for $65$ and $0.041$ ).
(i) $(1.62 \times 10^{-3})(7.3 \times 10^{-1})$ : Result rounded to $2$ sig digs.
(j) $(5.019 \times 10^{-4}) \div (3.1 \times 10^{-7})$ : Result rounded to $2$ sig digs.