Comprehensive Study Guide for Higher Mathematics: Relations, Vector Spaces, Complex Numbers, Matrices, and Diagonalization
General Concepts on Relations and Algebraic Structures
Relations Between Elements
- Definition of Relation:
- A relation between two sets is a triplet consisting of a starting set (domain of departure), an arrival set (target domain), and a subset of the Cartesian product , called the graph of the relation .
- Two relations and are equal if and only if , , and
- Example:
- Let and . The relation associating with its double in is given by .
- Properties of a Binary Relation:
- A binary relation defined on a set is said to be:
- Reflexive: if for all
- Symmetric: if for all
- Anti-symmetric: if and for all
- Transitive: if and for all
Equivalence Relation and Quotient Set
- Definition:
- A binary relation on a set is an equivalence relation if and only if it is reflexive, symmetric, and transitive.
- Quotient Set :
- Given an equivalence relation on :
- The equivalence class of , denoted or , is defined as .
- The quotient set relative to , denoted , is the set of all equivalence classes: .
- Example: Congruence Modulo :
- Let be a fixed positive integer. An integer is congruent to an integer modulo (written ) if and only if there exists an integer such that .
- Congruence modulo is an equivalence relation on :
- Reflexivity: , with , so
- Symmetry: , if such that
- Transitivity: , if and such that and . Adding both equations yields
- The equivalence class of is .
- The quotient set is .
- Detailed evaluation for :
- , ,
- Example: Consumer Indifference Curves:
- A consumer holds two goods and in non-negative quantities . A state represents a point
- The relation between states and is defined by .
- Equivalence classes under are called indifference curves.
- For state :
- Equation of the indifference curve: .
Order Relation
- Definition:
- A binary relation on is an order relation if it is reflexive, anti-symmetric, and transitive.
- An order relation is generally denoted by . The pair is called an ordered set.
- Two elements are comparable if or
- An ordered set is totally ordered if all pairs of elements are comparable.
- Examples:
- , , , and are totally ordered sets.
- For , the power set is partially ordered, because singletons ({1}) and ({2}) are not comparable.
Review of Number Sets
- Natural Numbers :
- . Contains a smallest element , and every natural number has a successor.
- The equation has no solution in ().
- Integers :
- .
- Every element has a predecessor and a successor.
- forms an Abelian (commutative) group:
- Associativity:
- Neutral element :
- Inverse :
- Commutativity:
- forms a commutative unitary ring:
- Multiplication is associative, distributive over addition, and has a multiplicative identity
- Incomplete because has no solution in .
- Rational Numbers :
- .
- forms a field (corps commutatif): every non-zero element has a multiplicative inverse such that
- Real Numbers :
- has no solution in ().
- Algebraic irrationals: numbers that are roots of polynomial equations with integer coefficients (e.g., ).
- Transcendental irrationals: non-algebraic real numbers (e.g., ).
- Inclusion chain: .
- Intervals in :
- Open interval:
- Closed interval:
- Semi-open intervals: and
- Unbounded intervals: , , ,
Combinatorics (Combinatorial Analysis)
- Types of Mappings:
- Injective: for every distinct pair , .
- Surjective: for every , there exists such that .
- Bijective: both injective and surjective (unique for every ).
- Cardinality Properties:
- For an application between finite sets of sizes and :
- Injection
- Surjection
- Bijection
- Fundamental Counting Principle:
- If task can be performed in ways, and task in ways, both tasks together can be performed in ways.
- Example: Rolling a green die and a red die yields outcomes.
- Cartesian Product:
- Example: Forming couples (man, woman) from 6 women and 4 men yields possibilities.
- Arrangements with Repetition:
- Selecting elements from elements with repetition allowed:
- Example: Vehicle license plates consisting of 4 non-zero digits from give possibilities.
- Arrangements without Repetition:
- Injections from to ():
- Example 1: Parking 3 cars in a 4-spot parking lot yields ways.
- Example 2: Forming 4-digit distinct non-zero numbers from yields
- Permutations:
- Arrangement of elements taken at a time:
- Example: Parking 4 cars in 4 parking spots yields ways.
- Combinations (Subsets of size ):
- Number of subsets of size from an element set:
- Example: Selecting a 5-member delegation from 15 students yields ways.
- Binomial Theorem (Newton's Formula):
- Example:
- Pascal's Triangle:
- The coefficients of the binomial expansion are arranged in Pascal's triangle:

- Introduction to Discrete Probabilities
- Definitions:
- A random experiment is an experiment with known possible outcomes, but whose specific outcome cannot be predicted with certainty.
- An event is any subset of the sample space of outcomes.
- Complementary events: and such that
- Certain event: the set of all possible outcomes ().
- Impossible event: empty set ().
- Probability Formula:
- For equiprobable outcomes:
- Property:
- Examples:
- Drawing 1 card from a standard 52-card deck:
- Red card:
- Club card:
- King:
- Not the Ace of Hearts:
- Drawing 3 cards simultaneously from 52 cards:
- Total possible outcomes:
- All 3 red cards:
- All 3 same suit:
- All 3 aces:
Vector Spaces and Linear Maps
Generalities on Vector Spaces
- Definition:
- A real vector space (or vector space over ) is a triplet consisting of a non-empty set , an internal operation , and an external operation such that:
- is a commutative group.
- For all and :
- Elements of are called vectors, elements of the field are called scalars.
- Standard Examples:
- over .
- with componentwise addition and scalar multiplication.
- : polynomials of degree
- Subspaces:
- A subset is a subspace of if and only if:
- ,
- ,
- Examples:
- Subspace and itself.
- Set of symmetric matrices where .
- Linear Combination and Span:
- Expression is a linear combination of
- Subspace generated by : denoted or .
- Example:
- .
- Linear Independence and Basis:
- Vectors are linearly independent if
- A family forms a basis of if it is linearly independent and spans
- Canonical basis of : , , .
- Theorem: All bases of a finite-dimensional vector space have the same number of elements
- Dimension: represents the number of elements in any basis.
- Direct Sum:
- , there exists a unique and unique such that
- Theorem: Every subspace of a finite-dimensional vector space has a complementary subspace.
Linear Mappings (Linear Applications)
- Definition:
- A mapping between vector spaces over is linear if for all and :
- If , is an endomorphism.
- If , is a linear form.
- The space of linear maps from to is denoted .
- Image and Kernel:
- Image: , subspace of
- Kernel: , subspace of
- Examples:
- (linear).
- (linear).
- (not linear, due to constant term ).
- Isomorphisms & Rank-Nullity Theorem:
- An isomorphism is a bijective linear mapping.
- is injective .
- is surjective
- Rank-Nullity Theorem:
Usual Linear Mappings
- Vector Homotheties:
- . Represented by scalar matrix .
- : identity map; : zero map; : central symmetry.
- Dilations, Projections, and Symmetries:
- Given , a dilation of ratio on parallel to is defined as
- : symmetry with respect to parallel to ( - involutive).
- : projection onto parallel to ( - idempotent).
- Worked Example 2.3.1:
- Line , Plane in
- Determinant of basis matrix:
- Decomposition system for : , ,
- Projection onto parallel to ():
- Projection onto parallel to ():
- Dilation of ratio on parallel to :
Complex Numbers and Polynomials
- Complex Numbers
- Algebraic Form:
- , where is the real part, is the imaginary part, and
- Complex conjugate:
- Algebraic Operations:
- Addition:
- Multiplication:
- Multiplicative Inverse:
- Conjugate Identities: , .
- Polar / Trigonometric Form:

- Modulus:
- Argument: defined modulo such that and .
- Trigonometric form: .
- Examples:
-
-
- Operations in Polar Form:
-
-
- **De Moivre's Formula**: .
- Powers: z_1^{20} = (\sqrt{2})^{20} \left( \cos \frac{20\pi}{4} + i \sin \frac{20\pi}{4} \right) = 2^{10} (\cos 5\pi + i \sin 5\pi) = -1024$.\n - Trigonometric identities via De Moivre:\n (\cos \theta + i \sin \theta)^2 = \cos 2\theta + i \sin 2\theta = \cos^2 \theta - \sin^2 \theta + 2i \cos \theta \sin \theta\n \implies \cos 2\theta = \cos^2 \theta - \sin^2 \theta\sin 2\theta = 2 \sin \theta \cos \theta\n - **Square Roots of Complex Numbers**:\n - Solving (u + iv)^2 = a + bi leads to:\n - u^2 - v^2 = a\n - 2uv = b\n - u^2 + v^2 = \sqrt{a^2 + b^2}\n - Solutions: u^2 = \frac{1}{2}(a + \sqrt{a^2 + b^2})v^2 = \frac{1}{2}(-a + \sqrt{a^2 + b^2})u vb$.
- Example 1: Roots of : .
- Example 2: Roots of :
- Example 3: Solving
- Example 4: Solving .
-th Roots of Complex Numbers:
, for
-th roots of unity: .
The set of -th roots of unity forms a group under multiplication isomorphic to .
Primitive roots of unity: is primitive if
Cube roots of 1: , ,
Polynomial Functions
Definition:
- , where , degree
Derivatives and Taylor Formula:
- Taylor's Formula for Polynomials:
Roots and Factorization:
- is a root of if
- is a multiple root if
- Complex conjugate root theorem: If has real coefficients and , then
- Fundamental Theorem of Algebra (D'Alembert-Gauss): Every polynomial of degree over splits completely into linear factors: , where
- Geometric series identity: for
Matrices and Systems of Linear Equations
- Generalities on Matrices
- Definition:
- A real matrix of dimension is a rectangular array of real numbers with rows and columns: .
- Stock Matrix Example:

Special Types of Matrices:
Transpose: , dimension
Square Matrix: (order ).
Row / Column Vectors: dimension and respectively.
Symmetric Matrix:
Lower Triangular: for all
Upper Triangular: for all
Diagonal Matrix: for all
Scalar Matrix: diagonal matrix with equal diagonal elements
Identity Matrix : scalar matrix with diagonal elements equal to 1.
Zero Matrix : all entries equal to 0.
Matrix Operations
Addition: , defined only for matrices of identical dimensions . Commutative group .
Scalar Multiplication: .
Matrix Product:
For and , product is dimension with entries .
Associative, non-commutative in general.
Determinant of a Square Matrix
Order 2: .
Order 3 (Sarrus Rule): .
General Order :
Signature:
Minor : determinant of submatrix obtained by removing row and column
Cofactor:
Laplace Expansion: (along row ) or (along column ).
Invertible Square Matrices
A matrix is invertible (regular) iff
Formula for Inverse: , where is the comatrix.
IS-LM Model Application:
- System: .
- .
- Equilibrium: ,
Set of invertible matrices forms the General Linear Group .
- Cramerian Systems & Applications
Linear system of equations and unknowns.
If , system is Cramerian with unique solution , or
Maternity Hospital Bed Allocation Problem:

- Matrix Equation: .
- Rank of a Matrix and Linear Systems
- Rank : Maximum number of linearly independent rows/columns in
- Calculated by row echelon reduction or searching for non-zero minors.
- Rouché-Capelli Theorem:
- System is incompatible if .
- System is compatible if
- If , unique solution.
- If , infinitely many solutions with free variables.
- 4x4 Grid Puzzle Problem:

- Equations for arithmetic mean of adjacent cells:
-
-
-
-
- Matrix system solved via row reduction yields: , , , - Homogeneous Systems:
- is always compatible ( is trivial solution).
- If , solution space is a subspace of dimension
Matrix Diagonalization
Eigenvalues and Eigenvectors
- Definitions:
- is an eigenvalue of (or matrix ) if such that (or ).
- is an eigenvector.
- Set of eigenvalues: Spectrum or .
- Eigenspace associated with : or .
- Characteristic Polynomial:
- is an eigenvalue iff
- Spectral Study Example:
- Matrix .
- .
- Eigenvalues: (multiplicity 2), (multiplicity 1).
- Eigenspaces:
- ().
- ().
Diagonalizable Matrices
- Definition:
- A matrix is diagonalizable if it is similar to a diagonal matrix , where is the invertible matrix whose columns are eigenvectors of A$.\n - **Characterization**:\n - A_{n \times n}K^nA\n - AP_A(\lambda)K\dim V(\lambda) = m(\lambda)\lambda\n - Every real symmetric matrix is diagonalizable over \mathbb{R}.\n - **Worked Examples**:\n - 1) Matrix A = \begin{pmatrix} 2 & 0 & 1 \ 1 & 1 & 1 \ -2 & 0 & -1 \end{pmatrix}.\n - P_A(\lambda) = -\lambda(\lambda - 1)^2\n - \dim V(0) = 1\dim V(1) = 2. Diagonalizable!\n - P = \begin{pmatrix} 1 & 0 & 1 \ 1 & 1 & 0 \ -2 & 0 & -1 \end{pmatrix}D = \text{diag}(0, 1, 1).\n - 2) Non-diagonalizable Matrix A = \begin{pmatrix} -4 & 0 & -2 \ 0 & 1 & 0 \ 5 & 1 & 3 \end{pmatrix}.\n - P_A(\lambda) = -(\lambda - 1)^2(\lambda + 2)\dim V(1) = 1 \neq 2\mathbb{R}.\n\n- **Applications of Diagonalization**\n - **Powers of a Matrix**:\n - If A = P D P^{-1}A^k = P D^k P^{-1}k \in \mathbb{N}.\n - **Reduction of Conics and Quadrics**:\n - 5x^2 + 8xy + 5y^2 = 9 \implies \begin{pmatrix} x & y \end{pmatrix} \begin{pmatrix} 5 & 4 \ 4 & 5 \end{pmatrix} \begin{pmatrix} x \ y \end{pmatrix} = 9\n - Eigenvalues \lambda_1 = 1, \lambda_2 = 9 \implies X^2 + 9Y^2 = 9 (ellipse equation in principal coordinate axes).\n - **Systems of Linear Differential Equations**:\n - System \mathbf{Y}' = A \mathbf{Y}\mathbf{Y} = P \mathbf{Z}\mathbf{Z}' = D \mathbf{Z}z_i' = \lambda_i z_i \implies z_i(x) = k_i e^{\lambda_i x}).\n - **Simultaneous First-Order Linear Recurrent Sequences**:\n - Sequences defined by X_{n+1} = A X_n \implies X_n = A^n X_0 = P D^n P^{-1} X_0\n - Limits as n \to \inftyu_n, v_n, w_n \to 14$$).