Linear Algebra: Foundations and First Principles

Abstract

Linear algebra provides the mathematical machinery for representing and solving systems of linear equations, transforming geometric objects, and analyzing the behavior of dynamic systems. This article examines three foundational concepts—matrix multiplication, one-to-one functions, and complex eigenvalues—and demonstrates how they interconnect to form a coherent framework for understanding linear transformations and their properties.

Background

Linear algebra sits at the intersection of pure mathematics and applied science. Its core objects—vectors and matrices—encode relationships between variables and enable compact representation of transformations. To work effectively with these objects, we must understand both their algebraic properties and their geometric meaning.

Three concepts form a natural progression in linear algebra pedagogy. First, we need to understand how matrices combine through multiplication ^{[matrix-multiplication]}. Second, we must recognize when transformations are reversible, which requires the notion of one-to-one functions ^{[one-to-one-function]}. Third, we encounter the eigenvalue problem, which reveals the intrinsic structure of linear transformations—and sometimes this structure involves complex numbers ^{[complex-eigenvalues]}.

Key Results

Matrix Multiplication as Composition

Matrix multiplication is not element-wise multiplication; rather, it encodes the composition of linear transformations ^{[matrix-multiplication]}. For matrices $A$ (of size $m \times n$) and $B$ (of size $n \times p$), the product $AB$ is defined entry-wise as:

$$(AB)_{ij} = \sum_{k=1}^{n} A_{ik} B_{kj}$$

This definition ensures that if $A$ represents one transformation and $B$ represents another, then $AB$ represents their sequential application. A critical property is non-commutativity: in general, $AB \neq BA$ ^{[matrix-multiplication]}. This reflects the fact that the order of transformations matters—rotating then translating produces a different result than translating then rotating.

Invertibility and One-to-One Functions

For a linear transformation to be reversible, it must be one-to-one ^{[one-to-one-function]}. A function $f$ is one-to-one if distinct inputs always produce distinct outputs:

$$f(x_1) \neq f(x_2) \text{ whenever } x_1 \neq x_2$$

In the context of matrices, a square matrix $A$ represents an invertible transformation if and only if the corresponding linear map is one-to-one ^{[one-to-one-function]}. This is equivalent to requiring that $A$ has full rank and a non-zero determinant. The existence of an inverse is not a luxury—it is essential for solving systems of equations and understanding the reversibility of physical processes.

Eigenvalues and the Characteristic Equation

The eigenvalue problem asks: for which scalars $\lambda$ and non-zero vectors $\mathbf{v}$ does $A\mathbf{v} = \lambda \mathbf{v}$ hold? These special scalars are found by solving the characteristic equation ^{[complex-eigenvalues]}:

$$\det(A - \lambda I) = 0$$

For real matrices, the characteristic polynomial may have complex roots. Consider the matrix:

$$A = \begin{pmatrix} 7 & -5 \\ 5 & -1 \end{pmatrix}$$

The characteristic polynomial is $\lambda^2 - 6\lambda + 18 = 0$, which yields eigenvalues $\lambda = 3 \pm 3i$ ^{[complex-eigenvalues]}. Complex eigenvalues indicate that the transformation involves rotation and scaling in the complex plane, often signaling oscillatory or spiral behavior in dynamical systems ^{[complex-eigenvalues]}.

Worked Example

Consider the $2 \times 2$ matrix from the eigenvalue discussion:

$$A = \begin{pmatrix} 7 & -5 \\ 5 & -1 \end{pmatrix}$$

Step 1: Form the characteristic equation.

$$A - \lambda I = \begin{pmatrix} 7 - \lambda & -5 \\ 5 & -1 - \lambda \end{pmatrix}$$

Step 2: Compute the determinant.

$$\det(A - \lambda I) = (7 - \lambda)(-1 - \lambda) - (-5)(5)$$ $$= -7 - 7\lambda + \lambda + \lambda^2 + 25$$ $$= \lambda^2 - 6\lambda + 18$$

Step 3: Solve for eigenvalues.

Using the quadratic formula:

$$\lambda = \frac{6 \pm \sqrt{36 - 72}}{2} = \frac{6 \pm \sqrt{-36}}{2} = \frac{6 \pm 6i}{2} = 3 \pm 3i$$

The eigenvalues are complex conjugates, $\lambda_1 = 3 + 3i$ and $\lambda_2 = 3 - 3i$ ^{[complex-eigenvalues]}. This indicates that $A$ represents a transformation combining a scaling by factor $|3 + 3i| = 3\sqrt{2}$ with a rotation. The real part (3) governs the magnitude of growth or decay, while the imaginary part (±3) encodes the rotation angle.

Connections and Implications

These three concepts are deeply interwoven. Matrix multiplication allows us to compose transformations and express systems of equations compactly. One-to-one functions tell us when these transformations are invertible—a prerequisite for solving $A\mathbf{x} = \mathbf{b}$ uniquely. Eigenvalues reveal the "natural" directions and scales of a transformation, and their complex nature signals that the transformation cannot be diagonalized over the reals, requiring us to work in complex vector spaces.

Understanding these foundations prepares students for advanced topics: diagonalization, Jordan normal form, and applications to differential equations, control theory, and data analysis.

References

• ^{[matrix-multiplication]}
• ^{[one-to-one-function]}
• ^{[complex-eigenvalues]}

AI Disclosure

This article was drafted with the assistance of an AI language model. The mathematical content, structure, and pedagogical framing were guided by the author's class notes and course materials. All claims are cited to source notes. The AI was used to organize ideas, improve clarity, and ensure consistent formatting—not to generate novel mathematical results or claims unsupported by the source material.