(09/14) Lecture Comprehensive Study Guide on Integrating Factors, Euler's Method, and Existence Theorems

Integrating Factors for Non-Exact Differential Equations

  • Exactness condition for a first-order differential equation M(x,y)+N(x,y)y′=0M(x, y) + N(x, y) y' = 0 requires that:   ∂(μM)∂y=∂(μN)∂x\frac{\partial (\mu M)}{\partial y} = \frac{\partial (\mu N)}{\partial x}   where μ\mu is an integrating factor.

  • Expanding both sides using the product rule for partial derivatives yields:   M∂μ∂y+μ∂M∂y=N∂μ∂x+μ∂N∂xM \frac{\partial \mu}{\partial y} + \mu \frac{\partial M}{\partial y} = N \frac{\partial \mu}{\partial x} + \mu \frac{\partial N}{\partial x}

  • Rearranging all terms to one side gives the partial differential equation for μ\mu:   −N∂μ∂x+M∂μ∂y+(∂M∂y−∂N∂x)μ=0-N \frac{\partial \mu}{\partial x} + M \frac{\partial \mu}{\partial y} + \left( \frac{\partial M}{\partial y} - \frac{\partial N}{\partial x} \right) \mu = 0

  • Because this partial differential equation contains partial derivatives of μ\mu with respect to both xx and yy, solving for μ\mu generally requires simplification.

  • Simplifying Assumption: Assume μ\mu is a function of xx only, μ=μ(x)\mu = \mu(x).

    • Under this assumption, ∂μ∂y=0\frac{\partial \mu}{\partial y} = 0 and ∂μ∂x=dμdx\frac{\partial \mu}{\partial x} = \frac{d\mu}{dx}.

    • The partial differential equation reduces to an ordinary differential equation:     −Ndμdx+(My−Nx)μ=0-N \frac{d\mu}{dx} + \left( M_y - N_x \right) \mu = 0

    • Rearranging terms:     Ndμdx=(My−Nx)μN \frac{d\mu}{dx} = \left( M_y - N_x \right) \mu

    • Isolating dμdx\frac{d\mu}{dx} gives:     dμdx=My−NxNμ\frac{d\mu}{dx} = \frac{M_y - N_x}{N} \mu

  • Separability Condition:

    • Both MM and NN are original functions of two variables xx and yy.

    • For the ordinary differential equation dμdx=My−NxNμ\frac{d\mu}{dx} = \frac{M_y - N_x}{N} \mu to be linear or separable in xx, the coefficient quantity My−NxN\frac{M_y - N_x}{N} must be a function of xx only (denoted as p(x)p(x)).

    • If My−NxN\frac{M_y - N_x}{N} depends on both xx and yy, the equation cannot be separated to find μ(x)\mu(x).

    • If My−NxN=Q(y)\frac{M_y - N_x}{N} = Q(y) (a function of yy only), a corresponding integrated factor μ(y)\mu(y) can be found using an analogous formulation.

Questions & Discussion

  • Question: For clarification, is it assumed that yy is not a function of xx?

  • Response: In the background of differential equations, yy is indeed treated as a function of xx. However, when evaluating functions M(x,y)M(x,y) and N(x,y)N(x,y) and their partial derivatives, xx and yy are treated as independent input variables. Taking the assumption that μ\mu depends strictly on xx does not contradict yy being a function of xx in the broader context of solving the initial differential equation.

Euler's Method for Numerical Approximations

  • General Initial Value Problem Setup:   y′=f(t,y),y(t0)=y0y' = f(t, y), \quad y(t_0) = y_0

    • The exact solution curve passes through the initial point (t0,y0)(t_0, y_0) with an initial slope of y′(t0)=f(t0,y0)y'(t_0) = f(t_0, y_0).

  • Tangent Line Derivation:

    • Using the point-slope form, the equation of the tangent line at (t0,y0)(t_0, y_0) is:     y=y0+f(t0,y0)(t−t0)y = y_0 + f(t_0, y_0)(t - t_0)

  • Stepping Procedure:

    • Instead of following the true solution curve y(t)y(t), Euler's method steps along tangent line segments to approximate values of yy at discrete time intervals t1,t2,…,tnt_1, t_2, \dots, t_n

    • First Step (t1t_1): Advance from t0t_0 to t1t_1. Evaluate the tangent line at t1t_1 to compute y1≈y(t1)y_1 \approx y(t_1):     y1=y0+f(t0,y0)(t1−t0)y_1 = y_0 + f(t_0, y_0)(t_1 - t_0)

    • Second Step (t2t_2): Construct a new tangent line starting at (t1,y1)(t_1, y_1) with slope f(t1,y1)f(t_1, y_1):     y=y1+f(t1,y1)(t−t1)y = y_1 + f(t_1, y_1)(t - t_1)     Evaluate at t2t_2 to compute y2≈y(t2)y_2 \approx y(t_2):     y2=y1+f(t1,y1)(t2−t1)y_2 = y_1 + f(t_1, y_1)(t_2 - t_1)

  • General Euler's Formula:   yn+1=yn+f(tn,yn)×hy_{n+1} = y_n + f(t_n, y_n) \times h

    • n=0,1,2,…n = 0, 1, 2, \dots

    • f(tn,yn)f(t_n, y_n): The slope calculated at step nn.

    • hh: The uniform step size, where h=tn+1−tnh = t_{n+1} - t_n (e.g., h=0.2 sh = 0.2\,s, 0.1 s0.1\,s, or 0.01 s0.01\,s).

  • Numerical Performance and Accuracy Characteristics:

    • The initial point y0y_0 matches the exact solution y(t0)y(t_0) perfectly.

    • As nn increases, numerical drift occurs due to overshooting the linear tangent approximations relative to curved exact solution trajectories.

    • For example, an approximate value y1=1.5y_1 = 1.5 may correspond to an exact solution value y(t1)=1.43y(t_1) = 1.43

    • Agreement between numerical approximation yny_n and exact solution y(tn)y(t_n) improves as step size hh decreases or total steps nn increase over a fixed interval.

Existence Theorems and Equivalence to Integral Equations

  • Existence and Uniqueness Condition:

    • If f(t,y)f(t, y) and ∂f∂y\frac{\partial f}{\partial y} are continuous on a defined rectangle RR, then there exists an interval ∣t∣<h|t| < h (bounded by upper bound aa) such that a unique solution to the initial value problem exists.

  • Coordinate Transformation Assumption:

    • Without loss of generality, proofs often assume  y(0)=0\ y(0) = 0 (i.e., initial point at the origin (0,0)(0,0)).

    • If an initial point (t0,y0)(t_0, y_0) is not at the origin, a coordinate transformation (change of variables) translates (t0,y0)(t_0, y_0) to (0,0)(0,0), making geometric and analytic arguments simpler without restricting generality.

  • Fundamental Proof Principle:

    • It is analytically more convenient to demonstrate the existence of a solution to a related integral equation than directly to the differential equation.

  • Derivation of the Related Integral Equation:

    1. Assume a differentiable function y=ϕ(t)y = \phi(t) solves the differential equation y′=f(t,y)y' = f(t, y), such that:      ϕ′(t)=f(t,ϕ(t))\phi'(t) = f(t, \phi(t))

    2. Introduce a dummy variable of integration ss and integrate both sides from 00 to tt:      ∫0ty′(s) ds=∫0tf(s,ϕ(s)) ds\int_0^t y'(s)\,ds = \int_0^t f(s, \phi(s))\,ds

    3. Apply the Fundamental Theorem of Calculus to the left side:      ∫0ty′(s) ds=y(t)−y(0)\int_0^t y'(s)\,ds = y(t) - y(0)

    4. Substitute the initial condition y(0)=0y(0) = 0:      y(t)−0=∫0tf(s,ϕ(s)) dsy(t) - 0 = \int_0^t f(s, \phi(s))\,ds

    5. Yields the related integral equation:      y(t)=∫0tf(s,ϕ(s)) dsy(t) = \int_0^t f(s, \phi(s))\,ds

  • Proof of Equivalence (Integral Solution Solves Initial Value Problem):

    • Verification of Initial Condition:     Evaluate the integral equation at t=0t = 0:     y(0)=∫00f(s,ϕ(s)) ds=0y(0) = \int_0^0 f(s, \phi(s))\,ds = 0     An integral over an interval of length zero equals zero, satisfying y(0)=0y(0) = 0

    • Verification of Differential Equation:     Take the derivative with respect to tt on both sides of the integral equation:     y′(t)=ddt(∫0tf(s,ϕ(s)) ds)y'(t) = \frac{d}{dt} \left( \int_0^t f(s, \phi(s))\,ds \right)     By the Fundamental Theorem of Calculus:     y′(t)=f(t,ϕ(t))y'(t) = f(t, \phi(t))     This reproduces the original differential equation, proving that solving the integral equation is completely equivalent to solving the differential initial value problem.