Comprehensive Study Guide on Vector Operations, Dot Product, and Projections

Course Logistics and Systems

  • Homework assignments must be completed on the WebAssign platform.
  • Grades earned on WebAssign are configured to link and synchronize automatically with Canvas.

Overview of Vector Multiplication Operations

There are three distinct types of multiplication operations involving vectors in multivariable calculus and physics:

  • Scalar Multiplication: The product of a real number (a scalar cc) and a vector \frac{}{} transforms the magnitude of the vector while maintaining or reversing its directional axis.

    • Geometrically, multiplying a vector by a positive scalar stretches the vector if c>1c > 1 or shrinks (compresses) it if 0<c<10 < c < 1.
    • Algebraic definition for a vector \frac{}{} in three-dimensional space \frac{}{}:

c \begin{pmatrix} v_1 \ v_2 \ v_3 \begin{pmatrix} = \begin{pmatrix} c v_1 \ c v_2 \ c v_3 \begin{pmatrix}

  • Output Type: The result of scalar multiplication is always a vector.

    • Dot Product (Scalar Product): An operation taking two vectors and returning a single real number.
  • Output Type: The result of a dot product is always a scalar.

    • Cross Product: An operation taking two vectors in three-dimensional space and returning a third vector perpendicular to both input vectors.
  • Output Type: The result of a cross product is always a vector.

OperationInputOutput Type
Scalar MultiplicationScalar ×\times VectorVector
Dot ProductVector ⋅\cdot VectorScalar (Number)
Cross ProductVector ×\times VectorVector

The Dot Product: Algebraic Definition and Calculation

Algebraic Definition in Three Dimensions

Given two vectors \frac{}{} and \frac{}{} in three-dimensional real coordinate space \frac{}{}:

u=(u1u2u3)\mathbf{u} = \begin{pmatrix} u_1 \\ u_2 \\ u_3 \end{pmatrix}

v=(v1v2v3)\mathbf{v} = \begin{pmatrix} v_1 \\ v_2 \\ v_3 \end{pmatrix}

The dot product (denoted by a centered dot ⋅\cdot between vectors) is defined as the sum of the products of their corresponding components:

u⋅v=u1v1+u2v2+u3v3\mathbf{u} \cdot \mathbf{v} = u_1 v_1 + u_2 v_2 + u_3 v_3

Calculation Procedure

  1. Multiply the first coordinates of both vectors (u1v1u_1 v_1).
  2. Multiply the second coordinates of both vectors (u2v2u_2 v_2).
  3. Multiply the third coordinates of both vectors (u3v3u_3 v_3).
  4. Sum the three resulting products together to obtain a single scalar value.

Geometric Definition and Angle Determination

Geometric Formula

Every vector possesses both a length (magnitude or norm) and a direction. When two vectors \frac{}{} and \frac{}{} are placed tail-to-tail at the origin in two-dimensional space \frac{}{} or three-dimensional space \frac{}{}, they form an angle θ\theta between them.

The geometric relationship connecting vector magnitudes, the angle θ\theta, and the dot product is:

u⋅v=∥u∥∥v∥cos⁡(θ)\mathbf{u} \cdot \mathbf{v} = \|\mathbf{u}\| \|\mathbf{v}\| \cos(\theta)

Where:

  • ∥u∥\|\mathbf{u}\| is the magnitude (norm) of vector u\mathbf{u}.
  • ∥v∥\|\mathbf{v}\| is the magnitude (norm) of vector v\mathbf{v}.
  • θ\theta is the angle between u\mathbf{u} and v\mathbf{v} where 0≤θ≤π0 \le \theta \le \pi.

Geometric Derivation Intuition

By drawing a perpendicular line segment from the tip of one vector down to the line containing the other vector, right-angled triangles are formed within the plane spanned by the two vectors. Trigonometric ratios on these right triangles establish the identity u⋅v=∥u∥∥v∥cos⁡(θ)\mathbf{u} \cdot \mathbf{v} = \|\mathbf{u}\| \|\mathbf{v}\| \cos(\theta).

Formula for the Angle Between Two Vectors

Rearranging the geometric formula allows direct calculation of the cosine of the angle between any two non-zero vectors:

cos⁡(θ)=u⋅v∥u∥∥v∥\cos(\theta) = \frac{\mathbf{u} \cdot \mathbf{v}}{\|\mathbf{u}\| \|\mathbf{v}\|}

To find the exact angle θ\theta:

θ=arccos⁡(u⋅v∥u∥∥v∥)\theta = \arccos\left(\frac{\mathbf{u} \cdot \mathbf{v}}{\|\mathbf{u}\| \|\mathbf{v}\|}\right)

Orthogonality of Vectors

Mathematical Condition for Orthogonality

Two vectors u\mathbf{u} and v\mathbf{v} are defined as orthogonal (perpendicular, forming a right angle of 90∘90^\circ or π2\frac{\pi}{2} radians) if and only if their dot product is zero:

u⋅v=0\mathbf{u} \cdot \mathbf{v} = 0

Proof of the Orthogonality Property

When the angle θ=90∘=π2\theta = 90^\circ = \frac{\pi}{2}:

cos⁡(π2)=0\cos\left(\frac{\pi}{2}\right) = 0

Substituting this value into the geometric formula:

u⋅v=∥u∥∥v∥×0=0\mathbf{u} \cdot \mathbf{v} = \|\mathbf{u}\| \|\mathbf{v}\| \times 0 = 0

Because any number multiplied by zero equals zero, evaluating the scalar magnitudes is unnecessary when vectors are perpendicular; their dot product is guaranteed to be zero.

Logical Equivalence (If and Only If)

  • If two non-zero vectors are perpendicular (θ=π2\theta = \frac{\pi}{2}), then u⋅v=0\mathbf{u} \cdot \mathbf{v} = 0
  • Conversely, if u⋅v=0\mathbf{u} \cdot \mathbf{v} = 0 for non-zero vectors, then u\mathbf{u} and v\mathbf{v} are orthogonal to each other.

Practical Importance in Physics and Engineering

Orthogonal vectors serve as reference axes in physical systems (such as the standard Cartesian x-axis and y-axis system). Determining whether vectors are perpendicular provides critical structural information for spatial coordinate systems and force analyses.

Vector Projection and Force Decomposition

Physical Motivation: Force Decomposition

Consider an object sitting on a flat surface subjected to a force vector F\mathbf{F} applied at an angle:

  • Parallel Component: The portion of the force directed horizontally along the floor, pulling or pushing the object forward.
  • Perpendicular Component: The portion of the force directed vertically upward, attempting to lift the object off the ground.

Resolving a force into these components is known as force decomposition.

Mathematical Definition of Vector Projection

The vector projection of a vector b\mathbf{b} onto a vector a\mathbf{a} (denoted as projab\text{proj}_{\mathbf{a}} \mathbf{b}) represents the orthogonal shadow or image of b\mathbf{b} projected directly onto the line extending along a\mathbf{a}.

projab=(b⋅a∥a∥2)a\text{proj}_{\mathbf{a}} \mathbf{b} = \left(\frac{\mathbf{b} \cdot \mathbf{a}}{\|\mathbf{a}\|^2}\right) \mathbf{a}

Mathematical Properties of Vector Projection

  • Component Breakdown:
    • b⋅a\mathbf{b} \cdot \mathbf{a} is a scalar number representing the dot product.
    • ∥a∥2\|\mathbf{a}\|^2 is the square of the magnitude of vector a\mathbf{a}, which is a scalar number.
    • The ratio b⋅a∥a∥2\frac{\mathbf{b} \cdot \mathbf{a}}{\|\mathbf{a}\|^2} acts as a scalar scaling factor.
  • Direction: The resulting projected vector projab\text{proj}_{\mathbf{a}} \mathbf{b} points in the exact same line of direction as a\mathbf{a}.
  • Scalar Multiplication Role: Finding a projection reduces to scaling vector a\mathbf{a} by enlarging or shrinking its length using the computed scalar multiplier.

Step-by-Step Worked Examples

Example 1: Calculating the Angle Between Two Vectors

Find the angle θ\theta between the vector u=(122)\mathbf{u} = \begin{pmatrix} 1 \\ 2 \\ 2 \end{pmatrix} and the vector v=(201)\mathbf{v} = \begin{pmatrix} 2 \\ 0 \\ 1 \end{pmatrix}.

Step 1: Compute the Dot Product (Numerator)

u⋅v=(1×2)+(2×0)+(2×1)\mathbf{u} \cdot \mathbf{v} = (1 \times 2) + (2 \times 0) + (2 \times 1)

u⋅v=2+0+2=4\mathbf{u} \cdot \mathbf{v} = 2 + 0 + 2 = 4

Step 2: Compute Vector Norms (Denominator)

For u\mathbf{u}:

∥u∥=12+22+22=1+4+4=9=3\|\mathbf{u}\| = \sqrt{1^2 + 2^2 + 2^2} = \sqrt{1 + 4 + 4} = \sqrt{9} = 3

For v\mathbf{v}:

∥v∥=22+02+12=4+0+1=5\|\mathbf{v}\| = \sqrt{2^2 + 0^2 + 1^2} = \sqrt{4 + 0 + 1} = \sqrt{5}

Step 3: Apply the Cosine Angle Formula

cos⁡(θ)=u⋅v∥u∥∥v∥=435\cos(\theta) = \frac{\mathbf{u} \cdot \mathbf{v}}{\|\mathbf{u}\| \|\mathbf{v}\|} = \frac{4}{3\sqrt{5}}

Step 4: Express the Final Angle

θ=arccos⁡(435)\theta = \arccos\left(\frac{4}{3\sqrt{5}}\right)

Example 2: Calculating Vector Projection

Find the projection of a vector b\mathbf{b} onto vector a=(101)\mathbf{a} = \begin{pmatrix} 1 \\ 0 \\ 1 \end{pmatrix}, given that the dot product b⋅a=5\mathbf{b} \cdot \mathbf{a} = 5

Step 1: Calculate Magnitude and Squared Magnitude of Vector a

∥a∥=12+02+12=2\|\mathbf{a}\| = \sqrt{1^2 + 0^2 + 1^2} = \sqrt{2}

∥a∥2=(2)2=2\|\mathbf{a}\|^2 = (\sqrt{2})^2 = 2

Step 2: Determine the Scalar Scaling Factor

Scaling Factor=b⋅a∥a∥2=52=2.5\text{Scaling Factor} = \frac{\mathbf{b} \cdot \mathbf{a}}{\|\mathbf{a}\|^2} = \frac{5}{2} = 2.5

Step 3: Scale Vector a to Find the Projection Vector

projab=52(101)=(52×152×052×1)=(52052)=(2.502.5)\text{proj}_{\mathbf{a}} \mathbf{b} = \frac{5}{2} \begin{pmatrix} 1 \\ 0 \\ 1 \end{pmatrix} = \begin{pmatrix} \frac{5}{2} \times 1 \\ \frac{5}{2} \times 0 \\ \frac{5}{2} \times 1 \end{pmatrix} = \begin{pmatrix} \frac{5}{2} \\ 0 \\ \frac{5}{2} \end{pmatrix} = \begin{pmatrix} 2.5 \\ 0 \\ 2.5 \end{pmatrix}

Step 4: Geometric Interpretation

The original vector a\mathbf{a} is stretched by a factor of 2.52.5 along its own direction, resulting in the projected vector (2.502.5)\begin{pmatrix} 2.5 \\ 0 \\ 2.5 \end{pmatrix}.