“Matrix Products” gave matrix multiplication, and with it a way to write a whole system as one equation. The system 4x + 7y = 1, 2x + 6y = 8 becomes AX = B with A = [ 4 7 ; 2 6 ], X = [ x ; y ] and B = [ 1 ; 8 ]. Written that way it looks like a single equation asking to be divided by A.
There is no division of matrices. What replaces it is multiplication by an inverse, and the first job is to say what an inverse is.
Definition · Identity matrixIₙ is the n by n matrix with 1 down the main diagonal and 0 everywhere else. For any matrix A of matching size, AI = IA = A. It is the matrix that behaves the way 1 behaves among numbers.
Definition · Inverse matrixFor a square matrix A, an inverse is a matrix A⁻¹ of the same size with AA⁻¹ = A⁻¹A = I. A matrix has at most one inverse. Non-square matrices are excluded outright: AA⁻¹ and A⁻¹A cannot both be defined unless A is square.
Theorem · The 2 by 2 inverseIf A = [ a b ; c d ] and ad - bc ≠ 0 then A⁻¹ = (1/(ad - bc))[ d -b ; -c a ]. If ad - bc = 0, A has no inverse. Note what moves: a and d change places, while b and c stay where they are and change sign.
Multiply the two arrays before dividing by anything: [ a b ; c d ][ d -b ; -c a ] has top-left entry ad - bc, top-right -ab + ba = 0, bottom-left cd - dc = 0 and bottom-right -cb + da = ad - bc.
So the product is (ad - bc)I. If ad - bc ≠ 0, dividing every entry of the second array by ad - bc gives a product of exactly I, and multiplying in the other order gives (ad - bc)I as well. If ad - bc = 0 the product is the zero matrix, which is never I, so no scaling of that array can help.
Nor can any other matrix. Suppose some B had AB = BA = I. Multiplying A[ d -b ; -c a ] = 0 on the left by B gives (BA)[ d -b ; -c a ] = [ d -b ; -c a ] = 0, so a = b = c = d = 0 and A is the zero matrix — but then AB = 0, not I. So no B inverts A when ad - bc = 0.
□
Example · The inverse of [ 4 7 ; 2 6 ]ad - bc = 24 - 14 = 10. Swapping the diagonal and negating the other two entries gives [ 6 -7 ; -2 4 ], and dividing by 10 gives A⁻¹ = [ 3/5 -7/10 ; -1/5 2/5 ]. Checking one entry: the top-left of AA⁻¹ is 4(3/5) + 7(-1/5) = 12/5 - 7/5 = 1.
Any size: augment with I and row reduce
There is a 3 by 3 inverse formula. It is long, it is easy to misremember, and it is unnecessary, because the row reduction of “Gaussian Elimination” already does the work. Write A and the identity side by side as [ A | I ], reduce the left half to I, and the right half becomes A⁻¹.
The reason is that every row operation is itself a multiplication by some matrix, and the operations that carry A to I are exactly the operations that carry I to A⁻¹. Carrying them out on both halves at once records the whole sequence. If the left half cannot be reduced to I — a row of zeros appears — then A is singular, and the attempt has proved it.
Theorem · Solving a system with an inverseIf A is invertible, AX = B has the unique solution X = A⁻¹B. Multiplying both sides on the left by A⁻¹ gives A⁻¹AX = A⁻¹B, and A⁻¹A = I, so IX = X = A⁻¹B. The multiplication must be on the left on both sides: XA⁻¹ is a different product and is usually not even defined.
Example · A singular matrix, and the two systems behind itA = [ 2 3 ; 4 6 ] has ad - bc = 12 - 12 = 0, so there is no A⁻¹. Reducing [ A | I ] produces a zero row on the left, which is the same failure. And the systems agree: 2x + 3y = 1 with 4x + 6y = 2 has infinitely many solutions, while 2x + 3y = 1 with 4x + 6y = 5 has none. No single matrix A⁻¹ could deliver both answers.
Theorem · The inverse of a product reverses the orderIf A and B are invertible and the same size, (AB)⁻¹ = B⁻¹A⁻¹. Check it: (AB)(B⁻¹A⁻¹) = A(BB⁻¹)A⁻¹ = AIA⁻¹ = AA⁻¹ = I. The order reverses for the same reason socks come off after shoes.