Comprehensive Study Notes on Matrices and Matrix Algebra

Introduction to the Concept of Matrices

The study of matrices is a fundamental necessity in various branches of mathematics and serves as one of the most powerful tools in the field. Matrices simplify complex mathematical work significantly when compared to straightforward manual methods. As the mathematician Cantor stated, "The essence of Mathematics lies in its freedom." Historically, the concept of matrices evolved from attempts to find compact and simple methods for solving systems of linear equations. Identifying matrices solely as representations of coefficients in linear systems, however, underestimates their utility, which far exceeds that application.

In modern contexts, matrix notation and operations are essential components of electronic spreadsheet programs on personal computers. These programs are utilized across diverse fields such as business and science for tasks including budgeting, sales projections, cost estimation, and the analysis of experimental results. In physics, matrices are used to mathematically represent operations such as magnification, rotation, and reflection through a plane. Furthermore, matrices are integral to cryptography, genetics, economics, sociology, modern psychology, and industrial management.

Defining the Matrix and its Components

A matrix is formally defined as an ordered rectangular array of numbers or functions. These constituent numbers or functions are referred to as the elements or entries of the matrix. We typically denote matrices using capital letters. To illustrate, consider a situation where information about possessions needs to be expressed: if Radha has $15$ notebooks, this can be expressed as $[15]$. If she has $15$ notebooks and $6$ pens, it is expressed as $[15 \, 6]$, where the first number corresponds to notebooks and the second to pens. This system can expand to include multiple people and items, such as Radha, Fauzia, and Simran.

When arranged in a tabular form with notebooks in one column and pens in another, we create a matrix. For example, if Radha has $15$ notebooks and $6$ pens, Fauzia has $10$ notebooks and $2$ pens, and Simran has $13$ notebooks and $5$ pens, this data can be written as:

$\begin{bmatrix} 15 & 6 \\ 10 & 2 \\ 13 & 5 \end{bmatrix}$

In this arrangement, horizontal lines are called rows, and vertical lines are called columns. The first row represents Radha's items, the second represents Fauzia's, and the third represents Simran's. Conversely, the first column represents the count of notebooks for all three individuals, and the second column represents the count of pens.

Order and Notation of a Matrix

The order of a matrix is defined by the number of its rows and columns. A matrix with $m$ rows and $n$ columns is called a matrix of order $m \times n$ (read as an "m by n" matrix). For instance, a matrix with $3$ rows and $2$ columns is of order $3 \times 2$. The total number of elements in an $m \times n$ matrix is equal to the product $mn$.

In general notation, an $m \times n$ matrix is represented as:

$A = [a_{ij}]_{m \times n}$, where $1 \le i \le m$ and $1 \le j \le n$, with $i, j \in \mathbb{N}$.

The symbol $a_{ij}$ represents the element lying in the $i$-th row and $j$-th column, also known as the $(i, j)$-th element. For example, in a matrix $A$, the element $a_{12}$ is in the first row and second column. It is a standard convention in this study to follow the notation $A = [a_{ij}]$ for an $m \times n$ matrix and to consider only those matrices whose elements are real numbers or functions taking real values.

Matrices can also represent geometric coordinates. A point $(x, y)$ can be represented as a column matrix $\begin{bmatrix} x \\ y \end{bmatrix}$ or a row matrix $[x \, y]$. Vertices of rectilinear figures, like a quadrilateral $ABCD$ with vertices $A(1, 0)$, $B(3, 2)$, $C(1, 3)$, and $D(-1, 2)$, can be organized into a single matrix where each row or column represents a vertex.

Types of Matrices

Matrices are classified into several types based on their structure and elements:

(i) Column Matrix: A matrix that has only one column is a column matrix. Its general form is $A = [a_{ij}]_{m \times 1}$.

(ii) Row Matrix: A matrix that has only one row is a row matrix. Its general form is $B = [b_{ij}]_{1 \times n}$.

(iii) Square Matrix: A matrix in which the number of rows equals the number of columns ($m = n$) is a square matrix of order $n$. In a square matrix $A = [a_{ij}]_{n \times n}$, the elements $a_{11}, a_{22}, \dots, a_{nn}$ constitute the diagonal of the matrix.

(iv) Diagonal Matrix: A square matrix is a diagonal matrix if all its non-diagonal elements are zero. That is, $B = [b_{ij}]_{m \times m}$ is a diagonal matrix if $b_{ij} = 0$ whenever $i \ne j$.

(v) Scalar Matrix: A diagonal matrix is called a scalar matrix if all its diagonal elements are equal to a constant $k$. Formally, $B = [b_{ij}]_{n \times n}$ is scalar if $b_{ij} = 0$ for $i \ne j$ and $b_{ij} = k$ for $i = j$.

(vi) Identity Matrix: A square matrix where the diagonal elements are all $1$ and the rest are zero is an identity matrix, denoted by $I$. Formally, $A = [a_{ij}]_{n \times n}$ is an identity matrix if $a_{ij} = 1$ if $i = j$ and $a_{ij} = 0$ if $i \ne j$. Every identity matrix is a scalar matrix where $k = 1$.

(vii) Zero Matrix: A matrix is a zero or null matrix if all its elements are zero. It is denoted by the symbol $O$.

Equality of Matrices

Two matrices $A = [a_{ij}]$ and $B = [b_{ij}]$ are said to be equal if they fulfill two conditions: (i) they are of the same order, and (ii) each element of $A$ is equal to the corresponding element of $B$. This is written as $a_{ij} = b_{ij}$ for all $i$ and $j$. Symbolically, we write $A = B$. This principle allows for solving unknown variables by equating corresponding entries in two equal matrices.

Matrix Operations: Addition and Scalar Multiplication

Matrix Addition is defined only when two matrices have the same order. If $A = [a_{ij}]$ and $B = [b_{ij}]$ are both $m \times n$ matrices, their sum $C = A + B$ is an $m \times n$ matrix where $c_{ij} = a_{ij} + b_{ij}$ for all $i, j$. If matrices are of different orders, their sum is not defined.

Multiplication by a Scalar occurs when a matrix $A$ is multiplied by a scalar $k$. The resulting matrix $kA$ is obtained by multiplying every element of $A$ by $k$. Formally, $kA = [k(a_{ij})]_{m \times n}$. The negative of a matrix, denoted by $-A$, is defined as $(-1)A$. The difference of two matrices $A - B$ is defined as $A + (-B)$, provided they are of the same order.

Properties of Matrix Addition and Scalar Multiplication

Matrix addition follows several algebraic laws:

1. Commutative Law: $A + B = B + A$.
2. Associative Law: $(A + B) + C = A + (B + C)$.
3. Existence of Additive Identity: The zero matrix $O$ acts as the identity such that $A + O = O + A = A$.
4. Existence of Additive Inverse: For every matrix $A$, there exists $-A$ such that $A + (-A) = (-A) + A = O$.

For scalar multiplication, if $k$ and $l$ are scalars and $A$ and $B$ are matrices of the same order, the following properties hold:

1. $k(A + B) = kA + kB$
2. $(k + l)A = kA + lA$

Multiplication of Matrices

The product of two matrices $A$ and $B$ is defined if and only if the number of columns in matrix $A$ is equal to the number of rows in matrix $B$. If $A$ is an $m \times n$ matrix and $B$ is an $n \times p$ matrix, their product $C = AB$ is an $m \times p$ matrix.

The entry $c_{ik}$ in the resulting matrix is found by taking the $i$-th row of $A$ and the $k$-th column of $B$, multiplying corresponding elements, and summing the products:

$c_{ik} = a_{i1}b_{1k} + a_{i2}b_{2k} + \dots + a_{in}b_{nk} = \sum_{j=1}^{n} a_{ij}b_{jk}$

Key characteristics of matrix multiplication include:

1. Non-commutativity: In general, $AB \ne BA$. Even if both products are defined, they may have different orders or different corresponding elements.
2. Zero Product: It is possible for the product of two non-zero matrices to be a zero matrix ($AB = O$ even if $A \ne O$ and $B \ne O$).
3. Multiplication of diagonal matrices of the same order is commutative.

Properties of matrix multiplication include the Associative Law ($(AB)C = A(BC)$), Distributive Laws ($A(B + C) = AB + AC$ and $(A + B)C = AC + BC$), and the existence of a Multiplicative Identity ($IA = AI = A$ for an identity matrix $I$ and square matrix $A$).

Transpose of a Matrix

The transpose of a matrix $A$, denoted by $A'$ or $A^T$, is the matrix obtained by interchanging its rows and columns. If $A = [a_{ij}]_{m \times n}$, then $A' = [a_{ji}]_{n \times m}$.

Properties of the transpose are:

1. $(A')' = A$
2. $(kA)' = kA'$ (where $k$ is a constant)
3. $(A + B)' = A' + B'$
4. $(AB)' = B'A'$

Symmetric and Skew Symmetric Matrices

A square matrix $A$ is symmetric if $A' = A$, meaning $a_{ij} = a_{ji}$ for all $i, j$. A square matrix $A$ is skew-symmetric if $A' = -A$, meaning $a_{ij} = -a_{ji}$ for all $i, j$. For a skew-symmetric matrix, when $i = j$, we have $a_{ii} = -a_{ii}$, which implies $2a_{ii} = 0$ or $a_{ii} = 0$. Therefore, all diagonal elements of a skew-symmetric matrix must be zero.

Theorem 1 states that for any square matrix $A$ with real entries, $A + A'$ is a symmetric matrix and $A - A'$ is a skew-symmetric matrix. Theorem 2 states that any square matrix can be uniquely expressed as the sum of a symmetric and a skew-symmetric matrix:

$A = \frac{1}{2}(A + A') + \frac{1}{2}(A - A')$

Invertible Matrices

If $A$ is a square matrix of order $m$, and there exists another square matrix $B$ of the same order $m$ such that $AB = BA = I$, then $B$ is called the inverse of $A$ (denoted as $A^{-1}$). In this case, $A$ is said to be invertible. A rectangular matrix cannot have an inverse because $AB$ and $BA$ must be defined and equal, requiring both to be square. If $B$ is the inverse of $A$, then $A$ is also the inverse of $B$.

Theorem 3 (Uniqueness of Inverse) ensures that if the inverse of a square matrix exists, it is unique. This is proven by assuming two inverses $B$ and $C$ and showing that $B = BI = B(AC) = (BA)C = IC = C$. Theorem 4 states that if $A$ and $B$ are invertible matrices of the same order, then $(AB)^{-1} = B^{-1}A^{-1}$.

Questions & Discussion

Example 1: Consider information regarding men and women workers in three factories: Factory I ($30$ men, $25$ women), Factory II ($25$ men, $31$ women), and Factory III ($27$ men, $26$ women). This is represented as a $3 \times 2$ matrix:

$A = \begin{bmatrix} 30 & 25 \\ 25 & 31 \\ 27 & 26 \end{bmatrix}$

The element in the third row and second column ($26$) represents the number of women workers in factory III.

Example 2: If a matrix has $8$ elements, what are the possible orders? The factors of $8$ are $(1, 8), (8, 1), (4, 2),$ and $(2, 4)$. Thus, orders can be $1 \times 8, 8 \times 1, 4 \times 2,$ or $2 \times 4$.

Example 3: Construct a $3 \times 2$ matrix where $a_{ij} = \frac{1}{2}|i - 3j|$. The calculations for elements are: $a_{11} = \frac{1}{2}|1 - 3| = 1$, $a_{12} = \frac{1}{2}|1 - 6| = \frac{5}{2}$, $a_{21} = \frac{1}{2}|2 - 3| = \frac{1}{2}$, $a_{22} = \frac{1}{2}|2 - 6| = 2$, $a_{31} = \frac{1}{2}|3 - 3| = 0$, and $a_{32} = \frac{1}{2}|3 - 6| = \frac{3}{2}$. The matrix is:

$A = \begin{bmatrix} 1 & \frac{5}{2} \\ \frac{1}{2} & 2 \\ 0 & \frac{3}{2} \end{bmatrix}$

Example 11: Two farmers, Ramkishan and Gurcharan Singh, sell three varieties of rice: Basmati, Permal, and Naura. Their September sales ($A$) and October sales ($B$) are matrices. To find combined sales, compute $A + B$. To find decrease in sales, compute $A - B$. If they get a $2\%$ profit on October sales, find $0.02 \times B$. For October, Ramkishan's profit on Basmati, Permal, and Naura is $100$, $200$, and $120$ respectively; Gurcharan Singh's is $400$, $200$, and $200$ respectively.

Example 19: A political group promotes a candidate via telephone, house calls, and letters. Cost in paise: Telephone ($40$), Housecall ($100$), Letter ($50$). Contacts in City X: ($1000, 500, 5000$); City Y: ($3000, 1000, 10000$). Total spent is calculating the product of the contact matrix and cost matrix. Total for City X is $340,000$ paise ($3400$ rupees) and for City Y is $720,000$ paise ($7200$ rupees).