Image & Rank

Basis
Last updated: Tags: Linear Algebra

While the kernel captures what a linear map destroys — the inputs it sends to zero — the image captures what it creates: the full collection of outputs the map can possibly produce. Knowing the image tells you which target vectors are reachable, and its dimension, the rank, measures how much of the codomain the map actually fills.

Definition

For a linear map T:VWT: V \to W, the image (also called the range) of TT is the set of all outputs that TT can produce:

im(T){T(v):vV}={wW:vV such that T(v)=w}.\text{im}(T) \coloneqq \{T(v) : v \in V\} = \{w \in W : \exists\, v \in V \text{ such that } T(v) = w\}.

The image lives in the codomain WW. A vector wWw \in W belongs to im(T)\text{im}(T) if and only if the equation T(v)=wT(v) = w has at least one solution vVv \in V.

The image is a subspace

Claim: im(T)\text{im}(T) is a linear subspace of WW.

Proof: Since T(0V)=0WT(\mathbf{0}_V) = \mathbf{0}_W, we have 0Wim(T)\mathbf{0}_W \in \text{im}(T). Take any w1,w2im(T)w_1, w_2 \in \text{im}(T) and any c,dFc, d \in F. There exist v1,v2Vv_1, v_2 \in V with T(v1)=w1T(v_1) = w_1 and T(v2)=w2T(v_2) = w_2. By linearity,

cw1+dw2=cT(v1)+dT(v2)=T(cv1+dv2)im(T).c w_1 + d w_2 = c\,T(v_1) + d\,T(v_2) = T(cv_1 + dv_2) \in \text{im}(T).

So im(T)\text{im}(T) is closed under linear combinations, hence a subspace. \square

The column space

For a matrix AMm,n(F)A \in M_{m,n}(F), write A=[a1a2an]A = [a_1 \mid a_2 \mid \cdots \mid a_n] where ajFma_j \in F^m are the columns of AA. The image of the corresponding map TA(x)=AxT_A(x) = Ax is

im(A)={Ax:xFn}.\text{im}(A) = \{Ax : x \in F^n\}.

Every product AxAx is a linear combination of the columns of AA:

Ax=x1a1+x2a2++xnan.Ax = x_1\,a_1 + x_2\,a_2 + \cdots + x_n\,a_n.

So the image of AA is exactly the span of its columns. This subspace of FmF^m is called the column space of AA, often written col(A)\text{col}(A):

col(A)=span(a1,a2,,an).\text{col}(A) = \text{span}(a_1, a_2, \ldots, a_n).

A vector bFmb \in F^m belongs to col(A)\text{col}(A) if and only if the system Ax=bAx = b has at least one solution — which is precisely the consistency condition discussed in Linear Equations.

Surjectivity

The map T:VWT: V \to W is surjective (onto) if and only if im(T)=W\text{im}(T) = W — every vector in WW is reachable. For a matrix AMm,n(F)A \in M_{m,n}(F), surjectivity means the column space fills all of FmF^m, which happens exactly when the RREF of AA has a pivot in every row.

Rank

The rank of a linear map TT is the dimension of its image:

rank(T)dim(im(T)).\text{rank}(T) \coloneqq \dim(\text{im}(T)).

For a matrix, rank(A)\text{rank}(A) equals the number of pivot rows in the RREF of AA, which is also the number of linearly independent columns of AA.

An important theorem (whose proof uses the RREF argument) states that the rank of a matrix equals both the dimension of its column space and the dimension of its row space (the span of its rows). In symbols: the number of linearly independent columns always equals the number of linearly independent rows.

Computing the image and rank

To find im(A)\text{im}(A) and rank(A)\text{rank}(A), apply Gauss-Jordan elimination to AA:

  1. Reduce AA to RREF.
  2. Count the pivots — this number is rank(A)\text{rank}(A).
  3. The pivot columns of AA (the original columns, before row reduction, whose positions correspond to pivot positions in the RREF) form a basis for col(A)\text{col}(A).

Important: use the pivot columns from the original matrix AA, not from the RREF, because row operations change the column vectors but preserve which columns are pivot columns.

Worked example

Let

A=(121243122).A = \begin{pmatrix} 1 & 2 & 1 \\ 2 & 4 & 3 \\ 1 & 2 & 2 \end{pmatrix}.

Apply Gauss-Jordan. R2R22R1R_2 \leftarrow R_2 - 2R_1, R3R3R1R_3 \leftarrow R_3 - R_1:

(121001001).\begin{pmatrix} 1 & 2 & 1 \\ 0 & 0 & 1 \\ 0 & 0 & 1 \end{pmatrix}.

R3R3R2R_3 \leftarrow R_3 - R_2:

(121001000).\begin{pmatrix} 1 & 2 & 1 \\ 0 & 0 & 1 \\ 0 & 0 & 0 \end{pmatrix}.

R1R1R2R_1 \leftarrow R_1 - R_2 (backward sweep):

(120001000).\begin{pmatrix} 1 & 2 & 0 \\ 0 & 0 & 1 \\ 0 & 0 & 0 \end{pmatrix}.

This is RREF. There are 2 pivots (columns 1 and 3), so rank(A)=2\text{rank}(A) = 2. The first and third columns of the original AA form a basis for col(A)\text{col}(A):

col(A)=span ⁣{(121), (132)}.\text{col}(A) = \text{span}\!\left\{ \begin{pmatrix}1\\2\\1\end{pmatrix},\ \begin{pmatrix}1\\3\\2\end{pmatrix} \right\}.

Summary

  • The image im(T)={T(v):vV}\text{im}(T) = \{T(v) : v \in V\} is always a subspace of the codomain WW.
  • For a matrix AA, the image equals the column space col(A)=span(a1,,an)\text{col}(A) = \text{span}(a_1, \ldots, a_n), and Ax=bAx = b is consistent if and only if bcol(A)b \in \text{col}(A).
  • TT is surjective if and only if im(T)=W\text{im}(T) = W (every output is reachable).
  • The rank rank(T)=dim(im(T))\text{rank}(T) = \dim(\text{im}(T)) equals the number of pivots in the RREF of AA.
  • Pivot columns of the original matrix form a basis for the column space.
  • The rank equals the dimension of both the column space and the row space.