1/126
Looks like no tags are added yet.
Name | Mastery | Learn | Test | Matching | Spaced | Call with Kai |
|---|
No analytics yet
Send a link to your students to track their progress
linear equation
A __________ in the variables x1, x2, …, xn has the form a1x1 + a2x2 + … + anxn = b1 where the coefficients and b1 are real numbers. A ___________ either has:
i) exactly one solution
ii) infinitely many solutions
iii) no solution
nonlinear
An equation that is not linear is said to be ______.
system of linear equations (linear system)
A ____________________ is a collection of one or more linear systems involving the same variables, say x1, x2, x3, …, xn.
solution of the system
A _____________in n variables is a set of n numbers S1, S2, …, Sn so that it satisfies each equation when we set x1 = S1, x2 = S2, …, xn = Sn.
solution set
The set of all solutions of a linear system is called the _________.
equivalent
Two linear systems are ________ if they have the same solution set.
consistent
A linear system is _______ if it has either 1 solution or infinitely many solutions. A system is in-_______ if it has no solution.
elementary row operations
i) Replacement: replacing a row by the sum of itself with a multiple of another row
ii) Interchange: swapping two rows
iii) Scaling: multiplying all entries of a row by a nonzero constant
row equivalent
Two matrices are ____________ if there exists a sequence of elementary row operations that transforms one system into the other.
If two augmented matrices are __________, the two systems have the same solution set.
Echelon form (row Echelon form)
A matrix is in __________ if it has the following properties:
i) All nonzero rows are above any rows of all zeros.
ii) Each leading entry of a row is in a column to the right of the leading entry of the row above it.
iii) All entries in a column below a leading entry are zero.
**Using elementary row operations, we can ALWAYS get a matriz in this form
reduced Echelon form (reduced row Echelon form)
If a matrix in Echelon form satisfies the additional conditions, then it is what we call ______________.
iv) The leading entry in each nonzero row is 1.
v) Each leading 1 is the only nonzero entry in its column.
**Using elementary row operations, we can ALWAYS get a matrix in this form
row equivalent echelon matrices
Theorem: Every matrix is row equivalent to one and only one (a unique) reduced Echelon matrix
pivot position
A ___________ in a matrix A is the location in A that corresponds to a leading 1 in the reduced Echelon form of A.
pivot column
A ___________ is a column of a matrix A that contains a pivot position.
row reduction algorithm
Forward phases:
Step 1: Begin with the left-most nonzero column (pivot column). The pivot position is at the top.
Step 2: Select a nonzero entry in the pivot column as a pivot. If necessary, interchange rows to move this entry into the pivot position.
Step 3: Use row replacement operations to create zeros in all positions below the pivot.
Step 4: Cover/ignore the row containing the pivot position and cover all rows, if any, above it. Apply Steps 1-3 to the remaining sub matrix. Repeat the process until there are no more rows to modify.
Backward phase:
Step 5: Begin with the right-most pivot and working upward and to the left, create zeros above each pivot. If a pivot (leading entry) is not 1, make it 1 using scaling.
basic variables and free variables
The variables that correspond to pivot columns are called _____________. The remaining variables, if any, are called ____________
existence and uniqueness
Theorem:
A linear system is consistent if and only if the right-most column of the augmented matrix is NOT a pivot column. That is, if and only if, an echelon form of the augmented matrix has no row of the form [0 0 … 0 b], where b ≠ 0.
If a linear system is consistent, then the solution set contains either:
a unique solution, where there are no free variables, or
infinitely many solutions where there are at least one free variable.
vector equivalence
Two vectors in ℝn are equal if and only if the corresponding entries are equal. Vectors in ℝn are n x 1 matrices or n-tuples with real numbers as entries.
zero vector
The _________ is a vector with only zeros as entries.
Algebraic Properties of ℝn
For all u, v, and w in ℝn and all scalars c and d:
i) Commutative Property: u + v = v + u
ii) Associative Property: (u + v) + w = u + (v + w)
iii) Additive Identity: u + 0 = 0 + u = u
iv) u + (-u) = 0, where -u is the Additive Inverse of u
v) Distributive Property: c(u + v) = cu + cv, where the left-hand side requires n additions and n multiplications, and the right-hand side requires n additions and 2n multiplications.
linear combination
Given the set of vectors v1, …, vp in ℝn and given the scalars c1, …, cp, the vector y is given by:
y = c1v1 + c2v2 + … + cpvp is called a ____________ of v1, v2, …, vp with weights (coefficients) c1, c2, …, cp.
spanned
If v1, …, vp are in ℝn , then the set of all linear combinations of v1, …, vp denoted by span {v1, …, vp} is the subset of ℝn ________(or generated) by v1, …, vp. So span {v1, …, vp} is the set of all vectors of the form c1v1 + c2v2 + … + cpvp with c1, …, cp as scalars.
Ax = b
Let A be an m x n matrix with columns a1, a2, …, an. Let x be in ℝn. Then, the product of A and x denoted by Ax is the linear combination of the columns of A using the entries of x as weights. Ax = [a1 a2 … an] [x1 … xn] = x1a1 + x2a2 + … + xnan
The number of entries in x is equal to the number of columns of A.
vector form = augmented matrix form
Theorem: If A is an m x n matrix with columns a1, a2, …, an and if b is in ℝm , the matrix equation Ax = b has the same solution set as the vector equation x1a1 + x2a2 + … + xnan = b which in turn has the same solution set as the linear equations whose augmented matrix is [a1 a2 … an b].
Ax= b equivalence statements
Theorem: Let A be an m x n matrix. Then the following statements are equivalent. That is, for a particular A, either all statements are true or all false.
i) For each b in ℝm , the equation Ax = b has a solution.
ii) Each b in ℝm is a linear combination of the columns of A.
iii) The columns of A span ℝm .
dot product (inner product)
Supposed x = [x1 … xn] (image as a column), y = [y1 … ym]. The product of y and x is given by yx = [y1 … yn][x1 … xn] = x1y1 + x2y2 + … + xnyn. yx is called the __________ of y and x.
identity matrix
The _____________ I has 1’s on the diagonal and zero’s elsewhere. If it is n x n, we denote it by In. If x is in ℝn , then Inx = X.
Property of matrix-vector product
Theorem: If A is an m x n matrix, v and u are vectors (in ℝn), c is a scalar, then:
i) A(u + v) = Au + Av (distributive)
ii) A(cu) = c(Au)
homogeneous linear systems
A system of linear equations is said to be _______________ if it can be written in the form Ax = 0. Here, A is an m x n matrix, x is an n x 1 vector, and 0 is an n x 1 zero vector.
The ___________ Ax = 0 ALWAYS has the trivial solution. (x = 0 is always a solution). The ___________ equation Ax = 0 has at least a nontrivial solution if and only if the solution set has at least 1 free variable.
nonhomogeneous systems
A linear system of equations of the form Ax = b with b ≠ 0 is called a _______________.
????
Theorem: Suppose the equation Ax = b is consistent for a given b, and let b be a solution. Then, the solution set of Ax = b is the set of all vectors of the form w = p + vh, where vh is any solution of the homogenous equation Ax = 0.
Steps to write the solution of a consistent system of equations in parametric vector form
i) Obtain the reduced row echelon form of the augmented matrix
ii) Express each basic variable in terms of any free variables
iii) Write a typical solution x as a vector whose entries depend on the free variables (if any)
iv) Decompose x into a linear combination of vectors using the free variables as parameters.
linear independence
Consider an indexed set of vectors {v1, v2, …, vp} in ℝn. The set of vectors is said to be ________________ if the equation:
c1v1 + c2v2 + … + cpvp = 0 (linear combination) has only the trivial solution c1 = c2 = … = cp = 0.
A set of TWO nonzero vectors {v1, v2} is __________ if and only if neither of the vectors are a multiple of the other
*Also applies to vector spaces
linear dependence
The set of vectors {v1, v2, …, vp} is _____________ if there exists weights c1, c2, …, cp not all zero such that:
c1v1 + c2v2 + … + cpvp = 0. That is, the vector equation has at least one nontrivial solution.
A set of TWO vectors {v1, v2} are __________ if one vector is a multiple of the other.
zero vector and linear dependence
Theorem: If a set S = {v1, v2, …, vp} in ℝn contains the zero vector, then the set is linearly dependent
Proof: Let S = {v1, v2, …, vp} be in ℝn. Suppose v1 = 0. Consider c1v1 + … + cpvp = 0.
(7)0 + (0)v2 + … (0)vp = 0. So c1 = 7, c2 = c3 = … = cp = 0 is a nontrivial solution. Therefore, the vectors in S are linearly dependent.
linear dependence for sets with more vectors than entries in each vector
Theorem: If a set contains more vectors than there are entries in the vectors, then the set is linearly dependent. That is, any set that has {v1 … vp} in ℝn is linearly dependent if p > n.
Proof: Let A = [v1 … vp]. Then, A is n x p. Consider the homogeneous equation Ax = 0 (always consistent). Assume p > n. The system has more variables than equations. The system must have free variables. Thus, the system will have nonzero solutions. Thus, the vectors/columns of A {v1 … vp} are linearly dependent.
linear dependence of vectors by linear combinations
Theorem: The set S = {v1 … vp} of two or more vectors is linearly dependent if and only if at least one vector in S is a linear combination of the other vectors in S.
transformation (mapping or function)
A ____________ T from ℝn to ℝm is a rule that assigns to each vector x in ℝn a vector T(x) in ℝm. ℝn is called the domain, and ℝm is called the codomain of T. (T: ℝn → ℝm)
image
For each x in ℝn, the vector T(x) in ℝm is called the ______ of x under the action of T. The set of all ________ T(x) is called the range of T. Sometimes codomain = range, but range is typically a subset.
linear transformations
A transformation T is linear if:
i) T(u + v) = T(u) + T(v) for all u and v in the domain of T.
ii) T(cu) = cT(u) for all u in the domain of T and all scalars c.
iii) T(0) = 0
iv) T(cu + dv) = cT(u) + dT(v) for all u and v in the domain of T and all scalars c and d
*So, every matrix transformation is a linear transformation
**Statements i and ii apply to vector spaces
matrix of linear transformations
Theorem: Let T: ℝn → ℝm be a linear transformation. Then, there exists a unique matrix A such that T(x) = Ax for all ℝn. A is such that the jth column is T(ej). where ej is the jth column of In. So, A = [T(e1) T(e2) … T(en)]. A is called the standard matrix for T.
onto
A mapping T: ℝn → ℝm is ______ ℝm if each b in ℝm is the image of at least one x in ℝn.
one-to-one
A mapping T: ℝn → ℝm is _______________ if each b in ℝm is the image of AT MOST one x in ℝn.
one-to-one transformations with only a trivial solution
Theorem: Let T: ℝn → ℝm be a linear transformation. Then, T is 1-1 if and only if the equation T(x) = 0 has only the trivial solution.
onto and 1-1 theorems
Theorem: Let T: ℝn → ℝm be a linear transformation and let A be the standard matrix for T. Then:
i) T maps ℝn onto ℝm if and only if the columns of A span ℝm.
ii) T is 1-1 if and only if the columns of A are linearly independent.
properties of matrix addition
Theorem: Let A, B, and C be matrices of the same size, and let r and s be scalars.
i) A + B = B + A; Commutative
ii) (A + B) + C = A + (B + C); Associative
iii) A + 0 = A; Additive identity
iv) r(A + B) = rA + rB
v) (r + s)A = rA + sA
vi) r(sA) = (rs)A
properties of matrix multiplication
Theorem: Let A be m x n, and B and C with sizes so that the indicated operations can be done. Let r be a scalar.
i) A(BC) = (AB)C; Associative
ii) A (B + C) = AB + AC; Distributive (left)
iii) (B + C)A = BA + BC; Distributive (right)
iv) r(AB) = (rA)B = A(rB)
v) InA = A = AIn
transpose
the __________ of a matrix A is the matrix found by writing its columns as rows (or rows as columns). The __________of A is denoted by AT.
properties of the transpose
Theorem: Let A and B be matrices whose sizes are appropriate for the following operations:
i) (AT)T = A
ii) (A + B)T = AT + BT
iii) (AB)T = BTAT
iv) For any scalar r, (rA)T = r(AT)
invertible
An m x n matrix A is said to be _______ if there exists an n x m matrix B called the inverse of A such that BA = I and AB = I. A matrix that is _______ is sometimes called “non-singular”. A matrix that is NOT _________ is called “singular”.
uniqueness of the inverse
The inverse of a matrix A is unique.
formula for the inverse for a two by two matrix
A-1 = (1/ad - bc)[d -b -c a], where (ad - bc) ≠ 0.
finding x in Ax = b using inverse properties
Theorem: If A is an m x n invertible matrix, then for each b in ℝn the equation Ax = b has the unique solution x = A-1b
properties of the inverse of matrices
i) If A is invertible, then A-1 is invertible, and (A-1)-1 = A.
ii) If A and B are order n (n x n) invertible matrices, then so is AB, and the inverse of AB is given by (AB)-1 = B-1A-1. Supposed A and B are n x n invertible matrices. Then, A-1 and B-1 exist. (AB)(B-1A-1) - A(BB-1)A-1 = AIA-1 = (AA-1)I = I.
iii) If A is invertible, then AT is invertible. The inverse of AT is (AT)-1 = (A-1)T.
iv) Theorem: A square matrix is invertible if det(A) ≠ 0
elementary matrix
An m x n matrix is called an _________________ if it can be obtained from the identity In by applying a single elementary row operation.
If we pre-multiply on the left of matrix A by an ________________, we get a matrix that is equal to the matrix we get when we apply the same operation on A.
Elementary matrices are invertible, and the inverse of an _________________ is an ____________________ of the same type.
characterization of the invertible matrix
Let A be a square n x n matrix. Then, the following statements are equivalent. That is, for a given A, the statements are either all true or all false.
i) A is an invertible matrix.
ii) A is row equivalent to the n x n identity matrix.
iii) A has n pivot positions
iv) The equation Ax = 0 has only the trivial solution.
v) The columns of A form a linearly independent set.
vi) The linear transformation x → Ax is one-to-one.
vii) The equation Ax = b has at least one solution for each b in ℝn.
viii) The columns of A span ℝn
ix) The linear transformation x → Ax maps ℝn onto ℝn.
x) There is an n x n matrix C such that CA = I.
xi) There is an n x n matrix D such that AD = I
xii) AT is an invertible matrix.
xiii) The columns of A form a basis for ℝn
xiv) col(A) = ℝn
xv) dim(col(A)) = n
xvi) rank(A) = n
xvii) Null(A)= {0}
xviii) nullity(A) = dim(Null(A)) = 0
xix) The number 0 is NOT an eigenvalue of A
xx) The det(A) ≠ 0
*if 0 was an eigenvalue, the determinant would be zero
invertibility of linear transformations pt. 1
Theorem: A linear transformation T: ℝn → ℝm is said to be invertible if there exists a function S: ℝn → ℝn such that
S(T(x)) = x for all x in ℝn (i)
T(S(x)) = x for all x in ℝn (ii)
invertibility of linear transformations pt. 2
Theorem: Let T: ℝn → ℝn be a linear transformation. Let A be the standard matrix for T. Then T is invertible if and only if A is an invertible matrix. In that case, the linear transformation S given by S(x) = A-1x is the unique function satisfying equations (i) and (ii)
cofactor
Supposed A is a square matrix. Aij is the matrix obtained from A by deleting the ith row and the jth column of A. The _________ is given by cij = (-1)i+j | Aij |.
determinant of an n x n matrix
If A is an n x n matrix, then the determinant of A is the sum of the entries of the first row of A times their cofactors. That is det(A) = a11c11 + a12c12 + … a1nc1n = summation of a1kc1k where k = 1 and goes to n = summation of a1k(-1)1+kdet(A1k) where k = 1 and goes to n.
expansion by cofactors
Theorem: Let A be an n x n matrix, then the determinant of A is given by…
Expansion across ith row: | A | = ai1ci1 + … + aincin
Expansion down jth column: | A | = a1jc1j + … + anjcnj
triangular matrix
a matrix where all the entries above or below the main diagonal are zeros
main diagonal
the diagonal of a matrix where the row index equals the column index
upper triangular
A matrix is ___________ if aij = 0 for i > j (AKA the space below the main diagonal are all zero entries)
lower triangular
A matrix is ____________ if aij = 0 for i < j (AKA the space above the main diagonal are all zero entries)
diagonal
A matrix is _________ if aij = 0 for i ≠ j.
determinant of a triangular matrix
Theorem: If A is a triangular matrix, then the determinant of A is the product of the elements along the main diagonal.
properties of determinants
Theorem: Let A be a square matrix.
i) If a multiple of 1 row of A is added to another row to produce B, then det(B) = det(A)
replacement operations do not change the determinant
ii) If 2 rows of A are interchanged to produce B, then det(B) = -det(A)
iii) If 1 row of A is multiplied by α, then det(B) = αdet(A)
determinants of n x n transposed matrices
Theorem: If A is n x n, then det(AT) = det(A)
determinant of multiplied matrices
Theorem: If A and B are n x n matrices, then the det(AB) = det(A)det(B)
using this theorem also proves that det(ABC) = det(A)det(B)det(C) where C is also an n x n matrix
vector space
A _______________ V is a non-empty set of objects, called vectors, on which are defined two operations called addition and multiplication by scalars, subject to ten axioms listed below. The axioms must hold for all vectors u, v, and w in V and scalars c and d.
Addition:
i) The sum of u and v denoted by u + v is in V (Closure under Addition)
ii) u + v = v + u (Commutative property)
iii) (u + v) + w = u + (v + w) (Associative property)
iv) There is a zero vector 0 such that u + 0 = u (Additive identity)
v) For each u in V, there is a vector -u (Additive inverse) in V such that u + (-u) = 0
Multiplication:
vi) The scalar multiple of u by c denoted by cu is in V (Closure under scalar multiplication)
vii) c(u + v) = cu + cv (Distributive property)
viii) (c + d)u = cu + du (Distributive property)
ix) c(du) = cd(u) (Associative property)
x) 1u = u (Scalar identity)
subspace
A _________ W of a vector space V is a subset W of V that has the 3 properties:
i) The zero vector is in W.
ii) W is closed under addition. So if u and v are in W, then u + v is in W.
iii) W is closed under multiplication by a scalar. If u is in W and c is a scalar, then cu is in W.
**Different than subset
symmetric
Matrix A is __________ if AT = A.
skew-symmetric
Matrix A is _______________ if AT = -A
spanning set (generated set)
Given a subspace H of a vector space V, a _____________ for H is a set of vectors S = {v1, …, vp} such that H = span(S)
The Null Space of A (kernel)
N(A) = {x: x is in ℝn and Ax = 0}.
Supposed A is an m x n matrix. Let N(A) be the set of all solutions to the homogeneous equation Ax = 0
row space of A
The ____________________ is the subspace of ℝn spanned by the row vectors of A.
column space of A
The ____________________ is the subspace of ℝn spanned by the columns of A. The __________________ is denoted by col(A).
range (in vector spaces)
The _____ of a linear transformation T is the set of all vectors in the vector space W of the form T(x).
____(T) = {y in W: T(x) = y, x is in V}
basis
Let H be a subspace of a vector space V. A set of vectors B = { v1, …, vp} is a _____ for H if
i) B is a linearly independent set
ii) H = span(B)
**If H is V, then B is a _____ for V
Spanning Set Theorem
Theorem: Let S = {v1, …, vp} be a set in V and H = span(S)
i) If one of the vectors in S, say Vk, is a linear combination of the remaining vectors in S, then the set formed from S by removing Vk still spans H.
iI) If H ≠ {0}, some subset of S is a basis for H.
basis and column spaces
Theorem: The columns of a matrix A that correspond to the pivot columns of A form a basis for col(A).
Uniqueness of Representation
Theorem: Let B = {b1, .., bn} be a basis for a vector space V. Then, for each x in V, there exists a unique set of scalars c1, c2, …, cn such that x = c1b1 + c2b2 + … + cnbn}
Proof:
Supposed B = {b1, …, bn} is a basis for a vector space V and x is an element in V. Since B spans V, then there are scalars c1, …, cn such that x = c1b1 + … + cnbn. Now assume there is another way to represent x in terms of B. That is x = d1b1 + … + dnbn for some scalars d1, …, dn.
Subtract the two equations from each other and get
0 = (c1b1 + … + cnbn) - (d1b1 + … + dnbn)
0 = (c1 - d1)b1 + … + (cn - dn)bn.
In the final equation, we have the linear combination of the vectors in B equal to zero. Since B is linearly independent, then all the coefficients must be zero. Thus, the representation is unique.
the coordinates of x relative to the basis of B (or B-coordinates of x)
Supposed B = {b1, …, bn} is a basis for a vector space V. The ________________________________________ are the unique weights such that x = c1b1 + … + cnbn
If c1, …, cn are the ____________________, then the vector [x]B = [c1 … cn] in ℝn is the _________________.
The mapping x → [x]B is the ______________________________ determined by B
standard basis
The _____________ is the simplest, most conventional basis for a vector space, consisting of orthogonal unit vectors that define the coordinate axes.
transition matrix from one coordinate system to another
P[x]B = [x]S where P is the matrix called the change of coordinates matrix, or the ___________________
The coordinate mapping
Supposed V is a vector space (maybe different from ℝn) with a basis B = {b1, …, bn}. The basis introduces a coordinate system in ℝn. For any x in V, we have c1, …, cn such that x = c1b1 + … + cnbn
[x]B = [c1 … cn]. So we have a mapping that takes x → [x]B that connects a possibly unfamiliar vector space V to a familiar space ℝn
coordinate mapping as a linear transformation
Theorem: Let B = {b1, …, bn} be a basis for a vector space V. Then, the coordinate mapping x → [x]B is a one-to-one linear transformation from V onto ℝn.
In general, a one-to-one linear transformation from a vector space V onto a vector space W is called an isomorphism.
checking linear dependence with vectors in a vector space given dimension of a basis
Theorem: If a vector space V has basis B = {b1, …, bn}, then any set in V containing more than n vectors must be linearly dependent.
basis’s in vector spaces and amount of vectors
Theorem: If a vector space V has a basis of n vectors, then every basis of V must consist of exactly n vectors.
finite-dimensional
If V is spanned by a finite set, then V is set to be ___________________, and the dimension of V written as dim(V) is the number of vectors in a basis of V. If V is NOT spanned by a finite number of vectors, then V is set to be in__________________.
expanding of a linearly independent subset to become a basis
Theorem: Let H be a subspace of a finite-dimensional vector space V. Any linearly independent set can be expanded, if necessary, to be a basis of H. Also, H is finite-dimensional and dim(H) <= dim(V).
qualifications for being a basis if dim(set) = dim(vector space) and is linearly indp/spans
Theorem: Let V be a p-dimensional vector space, p >= 1. Any linearly independent set of exactly p vectors in V is automatically a basis for V. OR Any set of exactly p vectors that spans V is automatically a basis for V.
**Note: The dimension of Null(A) is the number of free variables in the equation Ax = 0
**Note: The dimension of col(A) is the number of pivot columns of A.
row equivalence and equivalent basis’s of two matrices
Theorem: If two matrices A and B are row equivalent, then their row spaces are the same. If B is in row-echelon form, the nonzero rows of B form a basis for the row space of A, as well as B.
rank
The ____ of A is the dimension of col(A).
nullity
The _______ of A is the dimension of Null(A).
Rank Theorem
Theorem: The dimension of the column space and the row space of an m x n matrix A are equal. This common dimensions, the rank of A, also equals the number of pivot columns of A and satisfies the equation rank(A) + nullity(A) = n AKA the # of cols in A
eigenvalues and eigenvectors
Suppose A is an n x n matrix. We want to find all values of lambda and NONZERO x such that Ax = (lambda)x. Any pair (lambda)x that satisfies the equation is called an eigenpair of A, where (lambda) is called the ____________ of A and x is the corresponding _____________.
characteristic equation
det(A - lambda(I)) = 0
characteristic polynomial
a(lambda)2 + b(lambda) + c = 0
where a, b, and c are scalars and lambda is the unknown variable