The Central Idea

Consider the matrix

\[ \begin{bmatrix} 1 & 2 & -1 & 4\\ 0 & 3 & 5 & 7\\ 0 & 0 & 2 & 6 \end{bmatrix}. \]

The leading entries move to the right as we move downward through the rows.

The entries below each leading entry are zero.

This staircase pattern is the essential idea of row-echelon form.

If we continue reducing until each leading entry is \(1\) and is the only nonzero entry in its column, we obtain reduced row-echelon form.

Leading Entries

In a nonzero row, the leading entry is the first nonzero entry from the left.

For example, in

\[ [\,0\quad0\quad5\quad2\,], \]

the leading entry is

\[ \boxed{5}. \]

Pivot Positions

A leading entry used to organize row reduction is called a pivot.

The location of a pivot is called a pivot position.

Pivots help determine:

Pivot Columns

A pivot column is a column containing a pivot position.

For example, in

\[ \begin{bmatrix} 1 & 2 & 0\\ 0 & 3 & 5\\ 0 & 0 & 4 \end{bmatrix}, \]

all three columns are pivot columns.

Zero Rows

A zero row contains only zeros.

For example,

\[ [\,0\quad0\quad0\quad0\,]. \]

In echelon form, all zero rows must appear below all nonzero rows.

Definition of Row-Echelon Form

A matrix is in row-echelon form if:

  1. all nonzero rows are above any zero rows;
  2. the leading entry of each lower nonzero row lies to the right of the leading entry above it;
  3. all entries below each leading entry are zero.

The Staircase Pattern

Row-echelon form often looks like a staircase:

\[ \begin{bmatrix} \boxed{\ast} & \ast & \ast & \ast\\ 0 & \boxed{\ast} & \ast & \ast\\ 0 & 0 & \boxed{\ast} & \ast\\ 0 & 0 & 0 & 0 \end{bmatrix}. \]

The boxed entries represent pivots.

Example of Row-Echelon Form

The matrix

\[ \begin{bmatrix} 2 & 1 & -3\\ 0 & 5 & 4\\ 0 & 0 & 7 \end{bmatrix} \]

is in row-echelon form.

The pivots are

\[ 2,\qquad5,\qquad7. \]

Pivots Need Not Be \(1\) in REF

In row-echelon form, pivot entries do not have to equal \(1\).

For example,

\[ \begin{bmatrix} 3 & 2\\ 0 & -5 \end{bmatrix} \]

is still in row-echelon form.

Zeros Above Pivots Are Not Required in REF

Consider

\[ \begin{bmatrix} 1 & 4 & 2\\ 0 & 1 & 3\\ 0 & 0 & 1 \end{bmatrix}. \]

This is in row-echelon form even though entries above the second and third pivots are nonzero.

REF requires zeros below pivots, not above them.

Definition of Reduced Row-Echelon Form

A matrix is in reduced row-echelon form if it is in row-echelon form and also:

  1. every pivot equals \(1\);
  2. each pivot is the only nonzero entry in its column.

Example of RREF

The matrix

\[ \begin{bmatrix} 1 & 0 & 2 & 5\\ 0 & 1 & -3 & 4\\ 0 & 0 & 0 & 0 \end{bmatrix} \]

is in reduced row-echelon form.

The first two columns are pivot columns.

The third column is not.

REF Versus RREF

Property REF RREF
Zero rows at bottomRequiredRequired
Pivots move right as rows descendRequiredRequired
Zeros below pivotsRequiredRequired
Pivots equal \(1\)Not requiredRequired
Zeros above pivotsNot requiredRequired

Why REF Is Useful

Row-echelon form creates a triangular system.

That structure supports back substitution.

For example,

\[ \left[ \begin{array}{ccc|c} 1 & 2 & 1 & 8\\ 0 & 3 & -1 & 5\\ 0 & 0 & 2 & 6 \end{array} \right] \]

can be solved from the bottom row upward.

Back Substitution from REF

The last row gives

\[ 2z=6, \]

so

\[ z=3. \]

The second row gives

\[ 3y-z=5. \]

Thus,

\[ 3y-3=5, \] \[ y=\frac83. \]

Finish the REF Example

The first row gives

\[ x+2y+z=8. \]

Substitute

\[ y=\frac83, \qquad z=3. \]

Then

\[ x+\frac{16}{3}+3=8. \]

So

\[ x+\frac{25}{3}=\frac{24}{3}, \] \[ x=-\frac13. \]

Therefore,

\[ \boxed{ \left(-\frac13,\frac83,3\right) }. \]

Why RREF Is Useful

Reduced row-echelon form often lets us read the solution directly.

For example,

\[ \left[ \begin{array}{ccc|c} 1 & 0 & 0 & 2\\ 0 & 1 & 0 & -1\\ 0 & 0 & 1 & 4 \end{array} \right] \]

immediately gives

\[ \boxed{x=2,\qquad y=-1,\qquad z=4}. \]

RREF with a Free Variable

Consider

\[ \left[ \begin{array}{ccc|c} 1 & 0 & 2 & 5\\ 0 & 1 & -3 & 4\\ 0 & 0 & 0 & 0 \end{array} \right]. \]

The first and second columns are pivot columns.

The third column has no pivot.

Therefore, \(z\) is free.

Parameterize the Free Variable

Let

\[ z=t. \]

Then the first row gives

\[ x+2z=5, \]

so

\[ x=5-2t. \]

The second row gives

\[ y-3z=4, \]

so

\[ y=4+3t. \]

Thus,

\[ \boxed{ (x,y,z)=(5-2t,\ 4+3t,\ t) }. \]

Pivot Variables

A variable corresponding to a pivot column is called a pivot variable.

In the previous example:

\[ x \]

and

\[ y \]

are pivot variables.

The variable

\[ z \]

is free.

Free Variables

A free variable corresponds to a nonpivot variable column.

Free variables are not fixed to one unique value by the system.

They are assigned parameters so that the entire solution family can be described.

Unique Solution Criterion

For a consistent system with \(n\) variables, a unique solution occurs when every variable column contains a pivot.

Then no free variables remain.

Infinite-Solution Criterion

If a system is consistent but at least one variable column lacks a pivot, then at least one free variable remains.

The system has infinitely many solutions.

Inconsistency Criterion

An augmented matrix is inconsistent if row reduction produces a row of the form

\[ \boxed{ [\,0\quad0\quad\cdots\quad0\mid c\,] } \]

where

\[ c\ne0. \]

This represents

\[ 0=c, \]

which is impossible.

Example of Inconsistency

Consider

\[ \left[ \begin{array}{cc|c} 1 & 2 & 3\\ 0 & 0 & 5 \end{array} \right]. \]

The second row represents

\[ 0x+0y=5. \]

Therefore,

\[ \boxed{\text{the system is inconsistent}}. \]

Zero Rows and Redundancy

A zero row such as

\[ [\,0\quad0\quad0\mid0\,] \]

represents

\[ 0=0. \]

It adds no new constraint.

Such rows usually arise from dependent or redundant equations.

Zero Rows Belong at the Bottom

A matrix such as

\[ \begin{bmatrix} 1 & 2\\ 0 & 0\\ 0 & 3 \end{bmatrix} \]

is not in row-echelon form because a nonzero row appears below a zero row.

Leading Entries Must Move Right

Consider

\[ \begin{bmatrix} 1 & 2 & 3\\ 0 & 4 & 5\\ 0 & 6 & 7 \end{bmatrix}. \]

The second and third rows both begin in column \(2\).

Therefore, this is not in row-echelon form.

Zeros Must Appear Below Each Pivot

The matrix

\[ \begin{bmatrix} 1 & 2\\ 3 & 4 \end{bmatrix} \]

is not in row-echelon form because the entry below the first leading entry is nonzero.

RREF Requires Pivot \(1\)s

The matrix

\[ \begin{bmatrix} 2 & 0\\ 0 & 1 \end{bmatrix} \]

is in row-echelon form but not reduced row-echelon form because the first pivot is

\[ 2 \]

rather than

\[ 1. \]

RREF Requires Zeros Above Pivots

The matrix

\[ \begin{bmatrix} 1 & 4\\ 0 & 1 \end{bmatrix} \]

is in row-echelon form.

It is not in reduced row-echelon form because the second pivot column contains a nonzero entry above the pivot.

Reducing REF to RREF

Start with

\[ \begin{bmatrix} 1 & 4\\ 0 & 2 \end{bmatrix}. \]

First scale the second row:

\[ R_2\leftarrow\frac12R_2. \]

Then

\[ \begin{bmatrix} 1 & 4\\ 0 & 1 \end{bmatrix}. \]

Clear Above the Pivot

Now use

\[ R_1\leftarrow R_1-4R_2. \]

This gives

\[ \boxed{ \begin{bmatrix} 1 & 0\\ 0 & 1 \end{bmatrix} }. \]

The matrix is now in reduced row-echelon form.

REF Is Not Unique

A matrix can often be reduced to more than one valid row-echelon form depending on the row operations chosen.

For example, different nonzero scalar multiples of pivot rows may still satisfy the REF conditions.

RREF Is Unique

Every matrix is row equivalent to exactly one reduced row-echelon form.

This uniqueness makes RREF especially useful for classification and comparison.

Different correct row-reduction paths must eventually produce the same RREF.

Why RREF Uniqueness Matters

If two students use different legal row operations on the same matrix, their intermediate work may look different.

If both reduce completely and correctly, their final RREF must agree.

This provides a strong consistency check.

Row-Echelon Form and Gaussian Elimination

Gaussian elimination typically reduces a matrix to row-echelon form.

The system is then solved by back substitution.

Thus, REF is the natural target of forward elimination.

Reduced Row-Echelon Form and Gauss-Jordan Elimination

Gauss-Jordan elimination continues beyond REF until the matrix reaches RREF.

This eliminates both below and above each pivot.

Forward Elimination

During forward elimination:

  1. choose a pivot;
  2. move it into position if needed;
  3. create zeros below it;
  4. move down and right to the next pivot position.

The result is row-echelon form.

Backward Reduction

During backward reduction:

  1. scale pivots to \(1\);
  2. create zeros above each pivot;
  3. continue upward until every pivot column is clean.

The result is reduced row-echelon form.

Example: Reduce to REF

Start with

\[ \left[ \begin{array}{ccc|c} 1 & 2 & -1 & 3\\ 2 & 5 & 1 & 8\\ -1 & -1 & 2 & -1 \end{array} \right]. \]

Use

\[ R_2\leftarrow R_2-2R_1 \]

and

\[ R_3\leftarrow R_3+R_1. \]

This gives

\[ \left[ \begin{array}{ccc|c} 1 & 2 & -1 & 3\\ 0 & 1 & 3 & 2\\ 0 & 1 & 1 & 2 \end{array} \right]. \]

Finish the REF Reduction

Now use

\[ R_3\leftarrow R_3-R_2. \]

Then

\[ \boxed{ \left[ \begin{array}{ccc|c} 1 & 2 & -1 & 3\\ 0 & 1 & 3 & 2\\ 0 & 0 & -2 & 0 \end{array} \right] }. \]

This matrix is in row-echelon form.

Solve from the REF Matrix

The last row gives

\[ -2z=0, \]

so

\[ z=0. \]

The second row gives

\[ y+3z=2, \]

so

\[ y=2. \]

The first row gives

\[ x+2y-z=3, \]

so

\[ x+4=3, \] \[ x=-1. \]

Thus,

\[ \boxed{(-1,2,0)}. \]

Continue the Example to RREF

From

\[ \left[ \begin{array}{ccc|c} 1 & 2 & -1 & 3\\ 0 & 1 & 3 & 2\\ 0 & 0 & -2 & 0 \end{array} \right], \]

scale row \(3\):

\[ R_3\leftarrow-\frac12R_3. \]

Then

\[ \left[ \begin{array}{ccc|c} 1 & 2 & -1 & 3\\ 0 & 1 & 3 & 2\\ 0 & 0 & 1 & 0 \end{array} \right]. \]

Clear Above the Third Pivot

Use

\[ R_2\leftarrow R_2-3R_3 \]

and

\[ R_1\leftarrow R_1+R_3. \]

Then

\[ \left[ \begin{array}{ccc|c} 1 & 2 & 0 & 3\\ 0 & 1 & 0 & 2\\ 0 & 0 & 1 & 0 \end{array} \right]. \]

Clear Above the Second Pivot

Use

\[ R_1\leftarrow R_1-2R_2. \]

Then

\[ \boxed{ \left[ \begin{array}{ccc|c} 1 & 0 & 0 & -1\\ 0 & 1 & 0 & 2\\ 0 & 0 & 1 & 0 \end{array} \right] }. \]

This is RREF.

RREF Makes the Solution Immediate

The RREF matrix gives

\[ x=-1, \] \[ y=2, \] \[ z=0. \]

No back substitution is needed.

REF and RREF Encode the Same Solution Set

The original matrix, its REF, and its RREF are row equivalent.

They may look very different, but they represent equivalent systems with exactly the same solutions.

Classifying a System from REF

Suppose row reduction gives

\[ \left[ \begin{array}{ccc|c} 1 & 2 & 0 & 3\\ 0 & 1 & 4 & 5\\ 0 & 0 & 0 & 0 \end{array} \right]. \]

There are three variable columns but only two pivots.

The system is consistent with one free variable.

Therefore, it has infinitely many solutions.

Classifying a System from a Contradiction Row

Suppose row reduction gives

\[ \left[ \begin{array}{ccc|c} 1 & 0 & 2 & 3\\ 0 & 1 & -1 & 4\\ 0 & 0 & 0 & 5 \end{array} \right]. \]

The last row says

\[ 0=5. \]

Therefore,

\[ \boxed{\text{the system is inconsistent}}. \]

Rank Preview

The number of pivot positions in a matrix is closely related to its rank.

Rank measures how much independent row-column structure survives after reduction.

This concept will later help classify systems and understand linear dependence.

Rank and Free Variables

For a consistent system with \(n\) variables:

\[ \boxed{ \text{number of free variables} = n-\text{number of pivot variables} }. \]

Later, this becomes part of the rank-nullity relationship.

Homogeneous Systems in RREF

A homogeneous system has augmented column zero:

\[ A\mathbf{x}=\mathbf{0}. \]

Its RREF can reveal whether the only solution is the zero vector or whether free variables generate nontrivial solutions.

Homogeneous Unique Solution

If every variable column has a pivot, then the homogeneous system has only

\[ \boxed{\mathbf{x}=\mathbf{0}}. \]

This is the trivial solution.

Homogeneous Infinite Solutions

If at least one variable is free, then the homogeneous system has infinitely many solutions.

Because the system is homogeneous, those solutions form a structured set passing through the origin.

RREF and Solution Geometry

RREF reveals the dimension of the solution family:

One Free Variable Means One Degree of Freedom

Suppose

\[ \begin{bmatrix} 1 & 0 & 2 & 3\\ 0 & 1 & -1 & 4 \end{bmatrix} \]

represents two independent equations in three variables.

One variable is free.

Thus, the solution set has one degree of freedom.

Two Free Variables Mean Two Degrees of Freedom

One independent equation in three variables leaves two free variables.

Geometrically, the solution set is typically a plane.

Pivot Structure Does Not Depend on Row-Reduction Path

Different valid row operations may produce different intermediate matrices.

But the final RREF has the same pivot positions.

This means pivot structure is an intrinsic feature of the matrix, not an accident of one elimination path.

REF Can Be Faster by Hand

If the goal is only to solve one system, stopping at REF and using back substitution may require fewer steps than reducing fully to RREF.

This is why Gaussian elimination is often computationally efficient.

RREF Can Be Better for Interpretation

If the goal is to:

RREF is often more transparent.

Do Not Confuse REF with RREF

A matrix may be in REF without being in RREF.

For example,

\[ \begin{bmatrix} 1 & 2\\ 0 & 3 \end{bmatrix} \]

is REF.

It is not RREF because the second pivot is not \(1\), and the entry above it is nonzero.

Do Not Assume Every Staircase Matrix Is REF

Check all conditions.

A matrix may look triangular but fail REF if:

RREF of the Identity Matrix

The identity matrix

\[ I_n \]

is already in reduced row-echelon form.

Each pivot is \(1\), and every pivot column contains zeros everywhere else.

RREF of a Zero Matrix

A zero matrix is also in reduced row-echelon form.

It contains no nonzero rows and therefore violates none of the echelon conditions.

Augmented RREF and Direct Reading

Consider

\[ \left[ \begin{array}{cc|c} 1 & 0 & 4\\ 0 & 1 & -2 \end{array} \right]. \]

The system is simply

\[ x=4, \] \[ y=-2. \]

This is the ideal direct-reading structure.

RREF with a Nonpivot Column

Consider

\[ \left[ \begin{array}{ccc|c} 1 & 0 & 5 & 2\\ 0 & 1 & -3 & 7 \end{array} \right]. \]

The third variable column is nonpivot.

Thus, the third variable is free.

A Reliable REF-Recognition Workflow

  1. Move all zero rows mentally to the bottom and check whether they are already there.
  2. Locate the leading entry of each nonzero row.
  3. Check that each leading entry moves right as rows descend.
  4. Check that every entry below each leading entry is zero.

A Reliable RREF-Recognition Workflow

  1. First verify all REF conditions.
  2. Check that every pivot equals \(1\).
  3. Check that each pivot is the only nonzero entry in its column.

A Reliable REF-Solving Workflow

  1. Reduce the augmented matrix to REF.
  2. Check for contradiction rows.
  3. Identify pivot and free variables.
  4. Solve the bottom nonzero row first.
  5. Back-substitute upward.
  6. Parameterize free variables if necessary.

A Reliable RREF-Solving Workflow

  1. Reduce the augmented matrix fully to RREF.
  2. Check for inconsistency.
  3. Identify pivot and nonpivot variable columns.
  4. Assign parameters to free variables.
  5. Read pivot variables directly from the rows.
  6. Write the solution set clearly.

A Reliable Classification Workflow

  1. Row reduce to REF or RREF.
  2. If a contradiction row appears, classify the system as inconsistent.
  3. If the system is consistent, count pivot columns among variable columns.
  4. If every variable column has a pivot, the solution is unique.
  5. If at least one variable column is nonpivot, free variables remain and infinitely many solutions exist.

Common Errors

Requiring Pivots to Equal \(1\) in REF

That condition belongs to RREF, not ordinary REF.

Requiring Zeros Above Pivots in REF

REF requires zeros below pivots. RREF requires zeros both below and above.

Leaving a Zero Row Above a Nonzero Row

All zero rows must be at the bottom in echelon form.

Failing to Move Leading Entries Right

Each lower pivot must lie strictly to the right of the pivot above it.

Assuming a Zero Row Means No Solution

A zero row represents \(0=0\), not a contradiction.

Missing a Contradiction Row

A row ending in a nonzero augmented value after all variable entries are zero proves inconsistency.

Calling a Nonpivot Variable “Missing”

It is usually a free variable, not an error.

Failing to Parameterize Free Variables

Infinite solution sets should be described explicitly.

Assuming REF Is Unique

Many different REF matrices can be row equivalent to the same original matrix.

Assuming RREF Depends on the Reduction Path

RREF is unique for each matrix.

Practice

1. Identify REF

Is

\[ \begin{bmatrix} 2 & 3\\ 0 & 5 \end{bmatrix} \]

in row-echelon form?

Check Answer

Yes.

The second leading entry lies to the right of the first, and the entry below the first pivot is zero.

\[ \boxed{\text{REF}} \]

2. Identify RREF

Is

\[ \begin{bmatrix} 1 & 0\\ 0 & 1 \end{bmatrix} \]

in reduced row-echelon form?

Check Answer

Yes.

Each pivot is \(1\) and is the only nonzero entry in its column.

\[ \boxed{\text{RREF}} \]

3. REF but Not RREF

Classify

\[ \begin{bmatrix} 1 & 4\\ 0 & 2 \end{bmatrix}. \]
Check Answer

It is in row-echelon form.

It is not in reduced row-echelon form because the second pivot is \(2\), not \(1\), and there is a nonzero entry above it.

4. Not REF

Is

\[ \begin{bmatrix} 1 & 2\\ 0 & 0\\ 0 & 3 \end{bmatrix} \]

in row-echelon form?

Check Answer

No.

A nonzero row appears below a zero row.

5. Find Pivot Columns

For

\[ \begin{bmatrix} 1 & 0 & 2 & 4\\ 0 & 1 & -3 & 5\\ 0 & 0 & 0 & 0 \end{bmatrix}, \]

which columns are pivot columns?

Check Answer

The pivots occur in columns \(1\) and \(2\).

\[ \boxed{\text{Pivot columns: }1\text{ and }2} \]

6. Identify the Free Variable

For the previous matrix, if the first three columns correspond to \(x,y,z\), which variable is free?

Check Answer

The third variable column has no pivot.

\[ \boxed{z\text{ is free}} \]

7. Classify a Unique System

What does

\[ \left[ \begin{array}{cc|c} 1 & 0 & 3\\ 0 & 1 & -2 \end{array} \right] \]

tell you?

Check Answer

Both variable columns contain pivots.

The system has a unique solution:

\[ \boxed{(3,-2)}. \]

8. Classify an Infinite System

What does

\[ \left[ \begin{array}{ccc|c} 1 & 0 & 2 & 5\\ 0 & 1 & -1 & 4\\ 0 & 0 & 0 & 0 \end{array} \right] \]

tell you?

Check Answer

The system is consistent and the third variable is free.

\[ \boxed{\text{Infinitely many solutions}} \]

9. Classify an Inconsistent System

What does

\[ \left[ \begin{array}{cc|c} 1 & 2 & 3\\ 0 & 0 & 4 \end{array} \right] \]

tell you?

Check Answer

The second row gives

\[ 0=4. \] \[ \boxed{\text{No solution}} \]

10. Solve from REF

Solve

\[ \left[ \begin{array}{cc|c} 1 & 2 & 8\\ 0 & 3 & 6 \end{array} \right]. \]
Check Answer

The second row gives

\[ 3y=6, \] \[ y=2. \]

The first row gives

\[ x+4=8, \] \[ x=4. \]

Thus,

\[ \boxed{(4,2)}. \]

11. Parameterize from RREF

Describe the solutions of

\[ \left[ \begin{array}{ccc|c} 1 & 0 & 2 & 5\\ 0 & 1 & -3 & 4 \end{array} \right]. \]
Check Answer

Let

\[ z=t. \]

Then

\[ x=5-2t, \] \[ y=4+3t. \]

So

\[ \boxed{ (x,y,z)=(5-2t,\ 4+3t,\ t) }. \]

12. RREF Uniqueness

Can two correct complete row reductions of the same matrix produce different RREF matrices?

Check Answer

No.

The reduced row-echelon form of a matrix is unique.

\[ \boxed{\text{RREF is unique}} \]

Key Ideas

Where This Leads

Row-echelon and reduced row-echelon form give row reduction a precise destination. The staircase of pivots reveals which variables are constrained, which remain free, whether contradictions occur, and whether the system has one solution, infinitely many solutions, or none.

From here, the section can formalize Gaussian elimination and Gauss-Jordan elimination as complete algorithms, then connect pivots and reduced forms to rank, matrix equations, inverses, determinants, homogeneous systems, and the broader structure of linear algebra.