Notes on Substitution vs Faster Methods for Solving Linear Systems

Substitution approach: solving x in terms of y

  • Transcript highlights the idea of solving for x in terms of y first, then using that to proceed.
  • Question raised: what can you do then if you solve x in terms of y? The setting includes a student named Praneeth asking, “do you just substitute the whole equation of x into the other one?”
  • Response affirms the substitution approach: you have an equation in terms of x and y, and you substitute the entire expression for x into the other equation.
  • Problem identified: plugging the expression for x back into the other equation often leads to algebra that is not neat or elegant.
  • Conclusion in the transcript: this is not “a pretty process,” and there is a desire for a faster method.

The substitution method in detail

  • Goal: Solve a system of equations by expressing one variable in terms of the other and substituting.
  • Steps (substitution method):
    1. Solve one equation for x in terms of y (or y in terms of x): x = f(y) or y = g(x).
    2. Substitute that expression into the other equation to obtain an equation containing only one variable (y or x).
    3. Solve for that single variable.
    4. Substitute back to find the other variable.
    5. Check the solution in both original equations to verify.
  • Practical note: this approach can become algebraically heavy and prone to mistakes if the expressions are complex.

Example: illustrating substitution on a simple linear system

  • Consider:

    \begin{cases}
    2x + 3y = 12 \
    x - y = 1
    \end{cases}
  • Solve the second equation for x:
    x = y + 1
  • Substitute into the first equation:
    2(y + 1) + 3y = 12 \ \Rightarrow\ 5y = 10 \ \Rightarrow\ y = 2
  • Back-substitute to find x:
    x = y + 1 = 3
  • Check:
    • First equation: $2\cdot3 + 3\cdot2 = 6 + 6 = 12$ ✓
    • Second equation: $3 - 2 = 1$ ✓
  • This example demonstrates the mechanics of substitution and how it yields a unique solution in this case.

A faster method: elimination (linear systems)

  • Observation: Substitution can be slow; elimination offers a systematic way to cancel a variable and solve more directly.
  • Core idea: add or subtract multiples of equations to eliminate one variable, then solve the reduced equation and back-substitute.
  • General setup (two equations):

    \begin{cases}
    a1 x + b1 y = c1 \ a2 x + b2 y = c2
    \end{cases}
  • Eliminate x by forming a suitable combination:
    • Multiply equations so that the x-coefficients align (e.g., multiply the first by $a2$ and the second by $a1$) and subtract:
      a2(a1 x + b1 y) = a2 c1 a1(a2 x + b2 y) = a1 c2
      (a2 b1 - a1 b2) y = a2 c1 - a1 c2
      y = \frac{a2 c1 - a1 c2}{a2 b1 - a1 b2}, \quad \text{provided } a2 b1 - a1 b2 \neq 0.
    • Then substitute back to find x:
      x = \frac{c1 - b1 y}{a_1}
  • Eliminate y by forming a different combination if convenient (cancel the y-term instead):
    (a1 b2 - a2 b1) x = c1 b2 - c2 b1 \
    x = \frac{c1 b2 - c2 b1}{a1 b2 - a2 b1}
  • Cramer's Rule (compact form for 2x2 linear systems):
    • Determinants:
      D = a1 b2 - a2 b1, ilde{Dx} = c1 b2 - c2 b1, ilde{Dy} = a1 c2 - a2 c1
    • Solutions (when $D \neq 0$):
      x = \frac{\tilde{Dx}}{D}, \quad y = \frac{\tilde{Dy}}{D}

Quick comparison: when to use substitution vs elimination

  • Substitution is convenient when one equation easily isolates a variable (e.g., a simple expression like x = f(y)) and leads to straightforward arithmetic.
  • Elimination is often faster and less error-prone for linear systems, especially when:
    • Both equations are linear with two variables, and
    • You want to avoid fractions or complex expressions during intermediate steps.
  • For larger systems or computational work, matrix methods are typically preferred:
    • Represent the system as an augmented matrix and apply row reduction to reach reduced row echelon form.
    • Use matrix inverses or determinant-based formulas (e.g., Cramer's Rule) when applicable.

Connections to broader concepts and real-world relevance

  • Substitution and elimination are fundamental techniques in algebra for solving simultaneous equations found in physics, engineering, economics, and computer science.
  • These methods underpin more advanced linear algebra concepts, including matrix representations of systems and Gaussian elimination.
  • Practical takeaway: choose the method that minimizes algebraic complexity and error-prone steps for a given system; for quick hand-work, elimination often wins, while substitution can be intuitive when a variable is already isolated.