Grade 11 & 12 Dynamical Systems and Fractals Part 1

Put simply, a dynamical system is any system which changes over time. The study of dynamical systems is an important part of applied mathematics and allows us to understand and predict the long-term behaviour of many physical processes. When time is measured in discrete units (as opposed to continuous units) then we have what is called a discrete-time dynamical system. As a simple example, consider computing the compound interest on an investment (compound interest means that the interest earned is based on the current value of the investment). If the interest is compounded (added) annually, then it makes sense to define

x_{n}

as the value of the investment in year

n

If we start with some initial amount of money,

x_{0}

, after one year elapses the value of the investment will be

\begin{array}{r} x_{1} = x_{0} + r x_{0} = (1 + r) x_{0}, \end{array}

where

r

is the interest rate. Similarly, after a second year elapses, the investment will be worth

\begin{array}{r} x_{2} = x_{1} + r x_{1} = (1 + r) x_{1} . \end{array}

Are you starting to see a pattern? After

n

years, the investment is worth

\begin{array}{r} x_{n} = (1 + r) x_{n - 1} . \end{array}

If we define a function,

f (x) = (1 + r) x

, then we can write a model for the value of the investment after

n

years as

x_{n} = f (x_{n - 1})

. The value of the investment in year

n

depends on the value from the previous year, year

n - 1

, and this dependence is defined by the function

f (x)

This was a fairly simple example. There are many processes, both natural and man-made, which can be modelled as discrete-time dynamical systems. A few common examples include: population growth of plants and animals measured annually, radioactive decay, and bacteria growth. In order to study the dynamics of a system governed by the relation

x_{n} = f (x_{n - 1})

, we must understand the behaviour of the function

f (x)

when it is applied iteratively (multiple times) to some initial state.

Iterations of Functions

Let’s consider a function

f (x)

. We can think of functions as "machines" which map inputs to outputs.

If we want to model the long term behaviour of a discrete-time dynamical system defined by the relation

x_{n + 1} = f (x_{n})

then we will need to consider applying

f (x)

multiple times, or iterating

f (x)

Given some initial state (initial input)

x_{0}

, the iterates of $x_{0}$ under the function $f (x)$ are defined as follows.

Definition (Iterates of $f (x)$ )

Let $f (x)$ be a function such that $x_{0}$ is in the domain of $f (x)$ . Then we can define the following:

$x_{1} = f (x_{0}) = f^{[1]} (x_{0})$ is the first iterate of $x_{0}$ under $f (x)$ .
$x_{2} = f (x_{1}) = f (f (x_{0})) = f^{[2]} (x_{0})$ is the second iterate of $x_{0}$ under $f (x)$ .
$x_{n} = f (x_{n - 1}) = f (f (\dots f (x_{0}) \dots)) = f^{[n]} (x_{0})$ is the n^th iterate of $x_{0}$ under $f (x)$ .

The collection of these iterates ${x_{0}, x_{1}, x_{2}, \dots, x_{n}, \dots}$ is called the orbit of $x_{0}$ under $f (x)$ .

The orbit of a function can look very different depending on the starting value that we choose. Let’s look at some examples!

Example 1

Consider the function $f (x) = x^{2}$ with initial value $x_{0} = \frac{1}{2}$ .

The first iterate is $x_{1} = f (x_{0}) = f (\frac{1}{2}) = \frac{1}{4}$ .
The second iterate is $x_{2} = f (x_{1}) = f (\frac{1}{4}) = \frac{1}{16}$ .
The third iterate is $x_{3} = f (x_{2}) = f (\frac{1}{16}) = \frac{1}{256}$ .
Continuing this process, the orbit of $x_{0} = \frac{1}{2}$ under $f (x) = x^{2}$ is ${\frac{1}{2}, \frac{1}{4}, \frac{1}{16}, \frac{1}{256}, \frac{1}{65536} \dots}$ .

We see that the iterates of $f (x)$ continue to get smaller and smaller, eventually approaching zero.

Example 2

Once again, let $f (x) = x^{2}$ , and this time consider the initial value $x_{0} = 1$ .

The first iterate is $x_{1} = f (x_{0}) = f (1) = 1$ .
The second iterate is $x_{2} = f (x_{1}) = f (1) = 1$ .
The third iterate is $x_{3} = f (x_{2}) = f (1) = 1$ .
Continuing this process, the orbit of $x_{0} = 1$ under $f (x) = x^{2}$ is ${1, 1, 1, 1, 1 \dots}$ .

The value $x = 1$ is what is called a fixed point of $f (x)$ .

Example 3

Finally, let’s consider the initial value $x_{0} = 2$ , again with $f (x) = x^{2}$ .

The first iterate is $x_{1} = f (x_{0}) = f (2) = 4$ .
The second iterate is $x_{2} = f (x_{1}) = f (4) = 16$ .
The third iterate is $x_{3} = f (x_{2}) = f (16) = 256$ .
Continuing this process, the orbit of $x_{0} = 2$ under $f (x) = x^{2}$ is ${2, 4, 16, 256, 65536 \dots} .$

We see that the iterates of $f (x)$ continue to get larger and larger, eventually approaching infinity.

Fixed Points

In the previous section, we saw that a specific input value, namely the value

x_{0} = 1

, caused the orbit of the function

f (x) = x^{2}

to get "stuck" repeating a single value over and over. This type of a special value is called a fixed point of the function

f (x)

A function may have multiple fixed points, one fixed point, or no fixed points at all. We can find the fixed points of the function

f (x)

by solving the equation

f (\bar{x}) = \bar{x}

for all possible solutions

\bar{x}

which are in the domain of

f (x)

Example 4

Let’s go back to the function $f (x) = x^{2}$ from our previous examples. We know that this function has at least one fixed point since $f (1) = 1$ . Let’s find out if there are any others!

Set $f (\bar{x}) = \bar{x}$ and solve. $\begin{aligned} \to {\bar{x}}^{2} & = \bar{x} \\ {\bar{x}}^{2} - \bar{x} & = 0 \\ \bar{x} (\bar{x} - 1) & = 0 \end{aligned}$ This has two solutions: ${\bar{x}}_{1} = 0$ and ${\bar{x}}_{2} = 1$ , both of which must be fixed points of $f (x) = x^{2}$ .

Let’s check!
$f (0) = 0^{2} = 0$
$f (1) = 1^{2} = 1$

Exercise 1 Solution

Set $f (\bar{x}) = \bar{x}$ and solve. $\begin{aligned} \to {\bar{x}}^{2} - 2 & = \bar{x} \\ {\bar{x}}^{2} - \bar{x} - 2 & = 0 \\ (\bar{x} + 1) (\bar{x} - 2) & = 0 \end{aligned}$ This has two solution: ${\bar{x}}_{1} = - 1$ and ${\bar{x}}_{2} = 2$ , both of which must be fixed points of $f (x) = x^{2} - 2$ .

Let’s check!
$f (- 1) = (- 1)^{2} - 2 = 1 - 2 = - 1$
$f (2) = 2^{2} - 2 = 4 - 2 = 2$

Finding the fixed points of

f (x)

is equivalent to finding the intersections of the function

f (x)

with the line

y = x

. Let’s look once again at the function

f (x) = x^{2}

which we now know has two fixed points at

{\bar{x}}_{1} = 0

and

{\bar{x}}_{2} = 1

. These two fixed points correspond to the two intersections with the line

y = x

seen in the figure below.

When studying the dynamics of a system governed by the function

f (x)

, we are often interested in how the iterates of

f (x)

behave near its fixed points. Are they attracted towards a fixed point? Do they move away from the fixed point, never coming close to it? Or maybe they bounce around a fixed point, but never touch it? Using a figure like the one shown above, we can use a graphical approach to help determine the behaviour of some iterates of

f (x)

First, let’s choose a starting point near the fixed point

{\bar{x}}_{1} = 0

. To find the first iterate we simply draw a straight line up from

x_{0}

to the point

(x_{0}, f (x_{0}))

. To find the next iterate, we need to determine where

x_{1}

lies on the

x

-axis, so we draw a line over to the line

y = x

which gives us the point

(x_{1}, x_{1})

. Drawing a line straight down will intersect with the point

x_{1}

on the

x

-axis, and from here we can find the point

(x_{1}, f (x_{1}))

. Continuing the process, we find

x_{2}

x_{3}

, and so on, as shown in the figure below.

We can repeat this process using several starting values near the fixed point

{\bar{x}}_{1} = 0

which results in the next figure. This is called a cobweb diagram.

The cobweb diagram shown above indicates that iterates near the fixed point

{\bar{x}}_{1} = 0

tend to approach

0

. We might say that the iterates are attracted to the fixed point

{\bar{x}}_{1} = 0

What about the other fixed point

{\bar{x}}_{2} = 1

? Using the same process, we can draw a cobweb diagram for points near

{\bar{x}}_{2} = 1

We see from our diagram that when we start near the fixed point

{\bar{x}}_{2} = 1

the iterates move away from the fixed point. On the left hand side the iterates get smaller and smaller, once again approaching the fixed point

{\bar{x}}_{1} = 0

, whereas on the right hand side, the iterates get larger and larger, moving away from both fixed points. We say that the iterates are repelled away from

{\bar{x}}_{2} = 1

Attractive and Repelling Fixed Points

In the previous section we saw an example of both an attractive and a repelling fixed point. Let’s formalize what this means, starting with the definition of an attractive fixed point.

Definition (Attractive Fixed Point)

A fixed point $\bar{x}$ is an attractive fixed point of $f (x)$ if there exists an interval surrounding $\bar{x}$ , say $I = [a, b]$ with $a < \bar{x} < b$ , such that for all $x \in I$ , the iterates of $f (x)$ approach $\bar{x}$ in the limit as $n$ approaches infinity ( $f^{[n]} (x) \to \bar{x}$ ). Put in simple terms, this means that as $n$ gets large, the iterates $f^{[n]} (x)$ get arbitrarily close to $\bar{x}$ .

This could look something like this:

A number line between a and b. A point in the middle is marked as x with macron. To the left of x with macron is a sequence of points x subscript 0, x subscript 1, x subscript 2, and x subscript 3. An arrow points from each point to the next, moving to the right, and the points getting closer and closer to x with macron.

or like this:

A number line between a and b. From left to right are points x subscript 0, x subscript 2, x with macron, x subscript 3, and x subscript 1. Arrows point from x subscript 0 to 1 to 2 to 3 with the points getting closer and closer to x with macron.

Example 5

Once again we look at $f (x) = x^{2}$ . We saw graphically that the fixed point at $x = 0$ is an attractive fixed point. To show that this is true, let’s define the interval $I = [- 0.95, 0.95]$ which clearly contains the point $x = 0$ . Notice that all $x \in I$ satisfy $| x | < 1$ .

This means that if we choose any $x_{0} \in I$ , $| x_{1} | = | f (x_{0}) | < | x_{0} | < 1$ .

Repeating this argument, we see that $| x_{0} | > | x_{1} | > | x_{2} | > | x_{3} | > \dots > 0$ , i.e. the iterates are decreasing in magnitude towards the fixed point $x = 0$ .

Technically, a bit more work needs to be done to show that the sequence does in fact converge to the fixed point $x = 0$ , but that’s beyond the scope of this lesson.

Definition (Repelling Fixed Point)

A fixed point $\bar{x}$ is a repelling fixed point of $f (x)$ if there exists some interval around $\bar{x}$ , say $I = [a, b]$ with $a < \bar{x} < b$ , such that for all $x \in I$ , $x \neq \bar{x}$ , we have that $| f (x) - \bar{x} | > | x - \bar{x} |$ . This means that the function, $f$ , maps the point $x$ further away from the fixed point $\bar{x}$ .

A number line between a and b. A point in the middle is marked as x with macron. To the right of x with macron is a sequence of points x subscript 0, x subscript 1, and x subscript 2, moving away from x with macron. An arrow points from each point to the next, moving to the right.

Notice how the definition of a repelling fixed point only depends on the behaviour of the first iteration of $f$ , NOT the long term behaviour.

Example 6

Let’s look at $f (x) = x^{2}$ one last time. Our cobweb diagram indicated that the second fixed point at $x = 1$ is a repelling fixed point. To show that this is true, let’s define the interval $I = [0.5, 1.5]$ which contains $x = 1$ . For any $x \in I$ , $x \neq 1$ we have $\begin{aligned} | f (x) - 1 | & = | x^{2} - 1 | \\ = | x + 1 | | x - 1 | \\ \geq 1.5 | x - 1 | & (since x \in I) \\ > | x - 1 | . \end{aligned}$ Therefore $x = 1$ is a repelling fixed point.

Periodic Points

Another interesting behaviour we might come across when studying the iteration dynamics of a function are orbits which exhibit periodic behaviour, effectively jumping back and forth between a finite number of values. Let’s look at an example!

Example 7

Consider the function $f (x) = - \sqrt[3]{x}$ and the initial value $x_{0} = 1$ . We can see that $f (1) = - 1$ and $f (- 1) = 1$ . Therefore the orbit of $x_{0} = 1$ under $f (x)$ is ${1, - 1, 1, - 1, 1, - 1, \dots}$ . We say that the pair of points ${1, - 1}$ is a two-cycle of $f (x)$ .

Definition (Periodic Points)

The point $x_{0}$ is a periodic point of period $n$ of $f (x)$ if the following is true

$f^{[n]} (x_{0}) = x_{0}$ (this means $x_{0}$ is a fixed point of $f^{[n]} (x)$ ), and
$f^{[m]} (x_{0}) \neq x_{0}$ for all $m$ , $0 < m < n$ .

If $x_{0}$ is a periodic point of period $n$ , then the set ${x_{0}, x_{1}, x_{2}, \dots, x_{n - 1}}$ is called an $n$ -cycle of $f (x)$ .

We can use the first bullet point in the definition above in order to solve for the periodic points of period

n

of a function. Let’s take another look at the function

f (x) = - \sqrt[3]{x}

Example 8

Let’s say that we want to find all of the two cycles of the function $f (x) = - \sqrt[3]{x}$ . This means we need to find the fixed points of $f^{[2]} (x)$ . But what is $f^{[2]} (x)$ ?

$\begin{aligned} f^{[2]} (x) & = f (f (x)) \\ = - \sqrt[3]{f (x)} \\ = - {(- x^{1 / 3})}^{1 / 3} & (remember that \sqrt[3]{x} = x^{1 / 3}) \\ = x^{1 / 9} \end{aligned}$

To find the fixed points we solve $f^{[2]} (\bar{x}) = \bar{x}$ , i.e. ${\bar{x}}^{1 / 9} = \bar{x}$ . This has solutions $\bar{x} = - 1, 0,$ and $1$ . The point $\bar{x} = 0$ is a fixed point of the original function $f (x)$ (we could also call it a periodic point of period one) and the points ${1, - 1}$ form a two-cycle, as we saw previously.

Exercise 2 Solution

First, find the fixed points of $f (x)$ by solving $f (\bar{x}) = \bar{x}$ . $\begin{aligned} \frac{1}{\bar{x}} & = \bar{x} \\ {\bar{x}}^{2} = 1 \end{aligned}$ This has solutions ${\bar{x}}_{1} = - 1$ and ${\bar{x}}_{2} = 1$ . so these must be our fixed points.

Now we want to solve for the fixed points of $f^{[2]} (x)$ . $\begin{aligned} f^{[2]} (x) & = f (f (x)) \\ = \frac{1}{1 / x} \\ = x \end{aligned}$ Setting $f^{[2]} (\bar{x}) = \bar{x}$ gives $\bar{x} = \bar{x}$ . This is true for all values of $\bar{x}$ . Does this mean that all values of $\bar{x}$ are periodic points of period two of $f (x)$ ? Almost!

Since the points ${\bar{x}}_{1} = - 1$ and ${\bar{x}}_{2} = 1$ are fixed points of $f (x)$ , they cannot also be periodic points of period two. We also need to be careful and consider the domain of $f (x)$ , which excludes the point $x = 0$ (since $f (x) = \frac{1}{x}$ is undefined when $x = 0$ ). This means that $x = 0$ cannot be a periodic point of $f (x)$ . What we are left with is that all $x \in R$ except for $x = - 1, 1$ , and $0$ are periodic points of period two of $f (x)$ . We could write the set of periodic points of period two of $f (x)$ as ${x \in R | x \neq - 1, 1, 0}$ .

Grade 11/12 Math Circles
Dynamical Systems and Fractals Part 1

Discrete-Time Dynamical Systems

Iterations of Functions

Definition (Iterates of $f (x)$ )

Example 1

Example 2

Example 3

Fixed Points

Definition (Fixed Point)

Example 4

Exercise 1

Exercise 1 Solution

Attractive and Repelling Fixed Points

Definition (Attractive Fixed Point)

Example 5

Definition (Repelling Fixed Point)

Example 6

Periodic Points

Example 7

Definition (Periodic Points)

Example 8

Exercise 2

Exercise 2 Solution

Grade 11/12 Math Circles Dynamical Systems and Fractals Part 1

Discrete-Time Dynamical Systems

Iterations of Functions

Definition (Iterates of f(x))

Example 1

Example 2

Example 3

Fixed Points

Definition (Fixed Point)

Example 4

Exercise 1

Exercise 1 Solution

Attractive and Repelling Fixed Points

Definition (Attractive Fixed Point)

Example 5

Definition (Repelling Fixed Point)

Example 6

Periodic Points

Example 7

Definition (Periodic Points)

Example 8

Exercise 2

Exercise 2 Solution

Grade 11/12 Math Circles
Dynamical Systems and Fractals Part 1

Definition (Iterates of $f (x)$ )