Evanalysis
4.1Estimated reading time: 14 min

4.1 Homogeneous systems and null space

Use homogeneous systems and null spaces to describe all solutions systematically, not just one solution at a time.

Course contents

MATH1030: Linear algebra I

Rigorous linear algebra notes on systems, matrices, structure, and proof, with interaction used only where it clarifies the mathematics.

Chapter 1Systems of equations1 sections
Chapter 5Invertibility1 sections

By the time you can row-reduce a system, the next question is no longer "Can I solve this example?" but rather "What is the structure of every solution?" Homogeneous systems are the cleanest place to ask that question, and the null space is the language that answers it.

Why homogeneous systems are special

A homogeneous linear system is a system whose constant terms are all 0. In matrix form, it looks like

Ax=0.Ax = 0.

This situation is special for one immediate reason: the zero vector always solves it.

Definition

Homogeneous system

A homogeneous linear system is a linear system of the form

Ax=0.Ax = 0.

Its trivial solution is the zero vector x=0x = 0.

The real question is whether there are also nontrivial solutions.

The null space collects all homogeneous solutions

Definition

Null space

If AA is a matrix, the null space of AA is

N(A)={x:Ax=0}.N(A) = \{x : Ax = 0\}.

So N(A) is exactly the solution set of the homogeneous system Ax=0Ax = 0.

This definition turns a list of solutions into a mathematical object. Instead of saying "here are some vectors that work," you can describe the whole set at once.

Row reduction tells you the shape of the null space

To find N(A), you solve Ax=0Ax = 0 by reducing the augmented system [A0][A \mid 0]. The pivots tell you which variables are determined; the free variables tell you how many directions of freedom remain.

Worked example

Solve a homogeneous system and describe the null space

Let

A=[121242].A = \begin{bmatrix} 1 & 2 & -1 \\ 2 & 4 & -2 \end{bmatrix}.

To solve Ax=0Ax = 0, row-reduce:

[12102420][12100000].\left[ \begin{array}{ccc|c} 1 & 2 & -1 & 0 \\ 2 & 4 & -2 & 0 \end{array} \right] \sim \left[ \begin{array}{ccc|c} 1 & 2 & -1 & 0 \\ 0 & 0 & 0 & 0 \end{array} \right].

So the equation is

x1+2x2x3=0.x_1 + 2x_2 - x_3 = 0.

Take x2=sx_2 = s and x3=tx_3 = t as free variables. Then

x1=2s+t.x_1 = -2s + t.

Therefore

x=[2s+tst]=s[210]+t[101].x = \begin{bmatrix} -2s + t \\ s \\ t \end{bmatrix} = s \begin{bmatrix} -2 \\ 1 \\ 0 \end{bmatrix} + t \begin{bmatrix} 1 \\ 0 \\ 1 \end{bmatrix}.

So

N(A)=Span{[210],[101]}.N(A) = \operatorname{Span} \left\{ \begin{bmatrix} -2 \\ 1 \\ 0 \end{bmatrix}, \begin{bmatrix} 1 \\ 0 \\ 1 \end{bmatrix} \right\}.

This example shows why null-space descriptions are powerful. They tell you not only whether solutions exist, but how every solution is built.

Homogeneous solutions control nonhomogeneous ones

The same idea explains the structure of a system Ax=bAx = b when it is consistent.

Theorem

Every solution is a particular solution plus a null-space vector

Suppose xpx_p is one particular solution of Ax=bAx = b.

Then a vector x solves Ax=bAx = b if and only if

x=xp+vx = x_p + v

for some vN(A)v \in N(A).

This is the key structural theorem behind free-variable formulas.

Proof

Why the full solution set has the form xp+N(A)x_p + N(A)

A nonhomogeneous example

Worked example

Describe all solutions as a translate of the null space

Suppose the system Ax=bAx = b has one particular solution

xp=[301],x_p = \begin{bmatrix} 3 \\ 0 \\ 1 \end{bmatrix},

and suppose

N(A)=Span{[110]}.N(A) = \operatorname{Span} \left\{ \begin{bmatrix} 1 \\ -1 \\ 0 \end{bmatrix} \right\}.

Then every solution has the form

x=[301]+t[110]=[3+tt1],tR.x = \begin{bmatrix} 3 \\ 0 \\ 1 \end{bmatrix} + t \begin{bmatrix} 1 \\ -1 \\ 0 \end{bmatrix} = \begin{bmatrix} 3 + t \\ -t \\ 1 \end{bmatrix}, \qquad t \in R.

The null space gives the direction of freedom; the particular solution tells you where that family of solutions sits.

Why free variables force infinitely many homogeneous solutions

The reduced system viewpoint makes one important consequence immediate.

Theorem

A free variable creates infinitely many solutions

If the homogeneous system Ax=0Ax = 0 has at least one free variable, then it has infinitely many solutions.

The reason is not mysterious. A free variable may be assigned any real value, and each different assignment gives a different solution vector unless the parameter disappears completely.

This also gives a short theorem that is worth stating explicitly: if a homogeneous system has more variables than pivot equations, then at least one free variable remains, and the system must therefore have infinitely many solutions.

Worked example

One free variable already produces a whole line of solutions

Suppose row reduction shows that

x13x2=0.x_1 - 3x_2 = 0.

If x2=tx_2 = t, then x1=3tx_1 = 3t, so every solution has the form

[x1x2]=t[31],tR.\begin{bmatrix} x_1 \\ x_2 \end{bmatrix} = t \begin{bmatrix} 3 \\ 1 \end{bmatrix}, \qquad t \in R.

Different values of t give different vectors, so the homogeneous system has infinitely many solutions, not just more than one.

Worked example

A trivial null space can also occur

Let

A=[1001].A = \begin{bmatrix} 1 & 0 \\ 0 & 1 \end{bmatrix}.

Then Ax=0Ax = 0 is simply

x1=0,x2=0.x_1 = 0, \qquad x_2 = 0.

So the only solution is the zero vector, and therefore

N(A)={0}.N(A) = \{0\}.

This is the opposite extreme from the earlier example with free variables.

The null space is a subspace

This fact is easy to overlook because we first meet the null space as a solution set. But it is more than a solution set: it is always a subspace of the domain of AA.

Theorem

The null space is closed under linear combinations

For any matrix AA, the null space N(A) is a subspace. In particular:

  • 0N(A)0 \in N(A),
  • if u,vN(A)u, v \in N(A), then u+vN(A)u + v \in N(A),
  • if uN(A)u \in N(A) and c is a scalar, then cuN(A)cu \in N(A).

Proof

Why the null space is a subspace

This matters later because once you know a solution set is a subspace, you may look for a basis, count dimensions, and compare it to the pivot structure of the coefficient matrix.

Nullity counts how many independent directions remain

The previous discussion explains why the null space is not just a pile of solutions. It records how many genuinely independent directions of motion are still left after the pivot equations have imposed all their constraints.

Each free variable contributes one independent parameter. So the dimension of the null space is exactly the number of free variables in the reduced homogeneous system.

In rank language, this becomes

nullity(A)=nrank(A),\operatorname{nullity}(A) = n - \operatorname{rank}(A),

but even before that theorem is named formally, you should already read nullity as "the number of independent null-space directions left by the system."

Worked example

Membership in the null space is a direct test

Let

A=[110011],x=[111],z=[100].A = \begin{bmatrix} 1 & 1 & 0 \\ 0 & 1 & 1 \end{bmatrix}, \qquad x = \begin{bmatrix} 1 \\ -1 \\ 1 \end{bmatrix}, \qquad z = \begin{bmatrix} 1 \\ 0 \\ 0 \end{bmatrix}.

Then

Ax=[00],Az=[10].Ax = \begin{bmatrix} 0 \\ 0 \end{bmatrix}, \qquad Az = \begin{bmatrix} 1 \\ 0 \end{bmatrix}.

So xN(A)x \in N(A) but zN(A)z \notin N(A). This is the practical meaning of the definition: to test membership in N(A), compute Ax and check whether the result is exactly the zero vector.

How to read a basis for the null space from RREF

In practice, the basis vectors of N(A) come directly from the free-variable description of the reduced system.

The workflow is:

  1. row-reduce AA,
  2. identify pivot and free variables,
  3. set one free variable to 1 and the others to 0,
  4. solve for the pivot variables,
  5. repeat once for each free variable.

The vectors produced this way form a basis candidate for the null space because each one records one independent direction of freedom.

There is also a geometric distinction worth keeping clear:

  • a homogeneous solution set is always a subspace, so it passes through the origin;
  • a nonhomogeneous consistent solution set is usually a translate of that subspace by a particular solution.

That difference is exactly why N(A) is the structural core of the system, while xp+N(A)x_p + N(A) describes the full solution set of Ax=bAx = b.

Homogeneous solutions and column dependence

The null-space equation also explains when the columns of a matrix are dependent.

Let the columns of AA be a1,a2,,ana_1, a_2, \ldots, a_n. Then

Ax=0Ax = 0

is the same as

x1a1+x2a2++xnan=0.x_1 a_1 + x_2 a_2 + \cdots + x_n a_n = 0.

So a nontrivial solution of the homogeneous system is exactly a nontrivial linear relation among the columns.

Worked example

A nontrivial null-space vector gives a dependence relation

Suppose

x=[121]N(A).x = \begin{bmatrix} 1 \\ -2 \\ 1 \end{bmatrix} \in N(A).

Then

Ax=0Ax = 0

means

1a12a2+1a3=0.1 \cdot a_1 - 2 \cdot a_2 + 1 \cdot a_3 = 0.

This is a nontrivial dependence relation among the columns of AA.

What null space says about uniqueness

The structure theorem gives an immediate test.

  • If N(A)={0}N(A) = \{0\}, then a consistent system Ax=bAx = b has exactly one solution.
  • If N(A) contains a nonzero vector, then every consistent system Ax=bAx = b has infinitely many solutions, because you can add scalar multiples of that vector to a particular solution.

So null space measures the hidden freedom in the system.

Common mistakes

Common mistake

The zero vector always belongs to the null space

Students sometimes think a homogeneous system can have no solution. That is impossible, because x=0x = 0 always satisfies Ax=0Ax = 0.

Common mistake

A particular solution is not the whole solution set

Finding one vector xpx_p with Axp=bAx_p = b is only the start. You still need to add the whole null space to describe every solution.

Quick checks

Quick check

Why does Ax=0Ax = 0 always have at least one solution?

Answer in one sentence.

Solution

Answer

Quick check

If N(A)={0}N(A) = \{0\} and Ax=bAx = b is consistent, how many solutions does it have?

Use the theorem from this note.

Solution

Answer

Quick check

If Ax=0Ax = 0 has a free variable, can the solution set contain only two vectors?

Answer from the parameter form, not from a guess.

Solution

Answer

Exercise

Quick check

Suppose xpx_p solves Ax=bAx = b and u,vN(A)u, v \in N(A). Why do xp+ux_p + u and xp+vx_p + v both solve Ax=bAx = b?

Write one line using linearity.

Solution

Guided solution

This note builds on 2.3 Gaussian elimination and RREF and 2.4 Solution-set types. It prepares the way for 5.1 Invertible matrices and connects naturally with 6.2 Subspaces.

Section mastery checkpoint

Answer each question correctly to complete this section checkpoint. Correct progress: 0%.

Skills: homogeneous-system, trivial-solution

Why does every homogeneous system Ax = 0 have at least one solution?

Attempts used: 0

Attempts remaining: Unlimited attempts

Preview does not consume an attempt.

Submit records a graded attempt.

Skills: null-space, homogeneous-system

Fill in the blank: the null space of A is the set of all x such that ____.

Attempts used: 0

Attempts remaining: Unlimited attempts

Preview does not consume an attempt.

Submit records a graded attempt.

Syntax guidance: A short symbolic answer such as `Ax=0` is enough.

Skills: null-space, solution-structure, particular-solution

Suppose xp is one solution of Ax = b and v is in N(A). Which vector must also solve Ax = b?

Attempts used: 0

Attempts remaining: Unlimited attempts

Preview does not consume an attempt.

Submit records a graded attempt.

Key terms in this unit