Fixed-point Iteration Explained with Worked Examples

Fixed-point iteration solves by repeating from a starting value. If the values settle down, the limit is a root.

Write 2x or 2*x to multiply, ^ for powers, and ; between simultaneous equations. You can also type factor, expand, derivative of, integrate … from a to b, limit … as x->0 or 15% of 80.

Try an example

Before you start

This page is easier if you are comfortable with:

What Fixed-point iteration means

Rearrange into the form and iterate. For with , the values are 0.5403, 0.8576, 0.6543, 0.7935, ... approaching 0.7391. On a graph the iteration steps between the curve and the line , a picture called a staircase or cobweb, see cobweb and staircase diagrams.

The iteration converges to a root when , and it converges faster when is small; see fixed-point convergence. For the golden ratio, rearranged as gives 2, 1.5, 1.667, 1.6, ... approaching 1.618. A different rearrangement may diverge, so the choice matters.

A starting interval can be found by a change of sign. A cleverly chosen leads to the Newton–Raphson method, which converges much faster; for example finds . Rates of convergence are described in Newton's quadratic convergence. The derivative is in the derivative of a power. The theory of why such iterations converge is the Banach fixed-point theorem.

What is it used for?

Fixed-point iteration solves an equation by repeating one calculation until the answer stops changing.

How to use fixed-point iteration

  1. Rearrange the equation into .
  2. Choose a starting value near the root.
  3. Compute , , and so on.
  4. Stop when successive values agree to the accuracy needed.

Graph

The curves y = cos x and y = x meet at the fixed point 0.7391fixed point 0.739100.20.40.60.811.21.400.20.40.60.811.21.4The curves y = cos x and y = x meet at the fixed point 0.7391xyy = cos xy = xGraph with x from 0 to 1.5 and y from 0 to 1.5. Shows the curve y = cos x; the curve y = x; point fixed point 0.7391 at (0.7391, 0.7391).

The iteration steps between the two curves and spirals in to their intersection.

Worked examples

These examples are worked by hand, step by step, so you can compare your own working.

Example 1: cos x = x

Use with to find .

Worked example
Answer
x3≈0.6543 (limit 0.7391)x_3\approx0.6543\ (\text{limit }0.7391)
  1. x₁
  2. x₂
  3. x₃

Example 2: golden ratio

Use with to find .

Worked example
Answer
x3≈1.667 (limit 1.618)x_3\approx1.667\ (\text{limit }1.618)
  1. x₁
  2. x₂
  3. x₃

Example 3: square root of 2

Use with to find .

Worked example
Answer
x2≈1.41667 (2=1.41421)x_2\approx1.41667\ (\sqrt2=1.41421)
  1. x₁
  2. x₂

Special cases

A few situations come up again and again. Knowing them saves time and helps you spot answers that cannot be right.

x = cos x, x₀ = 1

x₁ = cos 1

0.5403.

x₂

cos 0.5403

0.8576.

x = √(x + 2), x₀ = 0

x₁ = √2

1.4142.

Limit of √(x + 2)

x² = x + 2

2.

Word problems

Rearrange f(x) = 0 as x = g(x) and iterate xₙ₊₁ = g(xₙ). It converges to a root if |g′| < 1 near it.

First step

x = cos x from x₀ = 1.

  1. cos 1
  2. Check: ✓0.5403

Second step

x₂ = cos(0.5403).

  1. 0.8576
  2. Check: ✓0.8576

Root iteration Higher

x = √(x + 2), x₀ = 0: x₁.

  1. √2
  2. Check: ✓1.4142

Limit Higher

Solve L = √(L + 2).

  1. L² = L + 2
  2. Check: L = 2 ✓2

Common mistakes

Any rearrangement works

always converges ✗

need |g′| < 1 ✓

Check.

Degrees

mixed ✗

radians ✓

Calculator mode.

Stopping too early

x₂ is the root ✗

continue until stable ✓

Convergence.

Divergent form

x = x² − 2 near 2 ✗

gives growth ✓

|g′| = 4.

Exam tips

  1. x = g(x).
  2. |g′| < 1 to converge.
  3. Radians.
  4. Iterate until stable.
  5. Cobweb diagrams show behaviour.

Practice questions

Try each one on paper, then open the answer. Use the solver above to see the full working.

1. x₁ = cos 0.5 Foundation

0.8776

2. x₁ for √(x + 2) from x₀ = 2 Foundation

2

3. x₁ for (x² + 2)/3 from x₀ = 1 Foundation

1

4. x₂ for √(x + 2) from x₀ = 0 to 4 d.p. Higher

1.8478

5. x₁ for 1/(1 + x) from x₀ = 1 Higher

0.5

6. x₂ for 1/(1 + x) from x₀ = 1 to 4 d.p. Higher

0.6667

Practice generator

Unlimited fresh questions with instant marking. Choose a level, work it out on paper, then type your answer.

Solve: …

Key terms

Fixed-point iteration
xₙ₊₁ = g(xₙ).
Fixed point
x = g(x).
Convergence
Values settle.
Starting value
x₀.
Rearrangement
x = g(x) form.
Cobweb diagram
Visual iteration.

Frequently asked questions

How does fixed-point iteration work?

Repeat xₙ₊₁ = g(xₙ).

When does it converge?

When |g′| < 1 near the root.

What is the root of x = cos x?

About 0.7391.

Why radians?

cos is a calculus function.

Which page covers Newton–Raphson?

Newton–Raphson.

Which page covers sign changes?

change of sign.

More in Numerical methods and optimisation and the formula sheets.