Artificial Intelligence 🤖
Stationary points

Stationary points

Stationary points are defined as:

💡

A point x=ax=a is called a stationary point of the function f(x)f(x) if f(a)f(a) exists and if f(a)=0f^{\prime}(a)=0.

For example, the stationary points of f(x)=x2x12f(x)=x^{2}-x-12 occur at f(x)=2x1=0f^{\prime}(x)=2 x-1=0. Solving for xx gives the only stationary point at x=1/2x=1 / 2. As another example consider f(x)=1cosxf(x)=1-\cos x with stationary points at f(x)=sinx=0f^{\prime}(x)=\sin x=0; this gives x=nπx=n \pi where nZn \in \mathbb{Z}. Of course there are functions with no stationary points where the gradient is never zero like for instance f(x)=x/(x+1)f(x)=x /(x+1) whose derivative is f(x)=(x+1)2f^{\prime}(x)=(x+1)^{-2}.

Second derivative test

Here we discuss local and global minimum and maximum values of a function; these occur at stationary points. We start with the definitions of local extrema.

💡

Suppose that x=ax=a is a stationary point of a differentiable function f(x)f(x). Then, the function f(x)f(x) has a:

(i) local minimum at x=ax=a if f(a)>0f^{\prime \prime}(a)>0

(ii) local maximum at x=ax=a if f(a)<0f^{\prime \prime}(a)<0

Note that if f(a)=0f^{\prime}(a)=0 we do not necessarily have a minimum or maximum point at x=ax=a. At a minimum value, the function changes from decreasing to increasing while at a maximum, the function changes from increasing to decreasing. If the function has a zero slope at x=ax=a but it is either always increasing or always decreasing on either side of the point, we refer to it as a point of inflection. Coming back to the second derivative test:

if f(a)=0f^{\prime \prime}(a)=0, the test is inconclusive: x=ax=a may be a local minimum, a local maximum, or a point of inflection.

If f(a)=0f^{\prime \prime}(a)=0 and f(a)0f^{\prime \prime \prime}(a) \neq 0 then x=ax=a is a point of inflection. Note that the converse is not true, i.e. if x=ax=a is a point of inflection then it does not follow that f(a)=0f^{\prime \prime}(a)=0 and f(a)0f^{\prime \prime \prime}(a) \neq 0. For instance, x=0x=0 is a point of inflection of f(x)=x5f(x)=x^{5} but f(0)=0f^{\prime \prime \prime}(0)=0.- Also, it is possible that f(a)=0f^{\prime \prime}(a)=0 at a point aa which is not a point of inflection, e.g. f(x)=x4f(x)=x^{4} at x=0x=0.

Higher-order (or general) derivative test

Since the second derivative test is inconclusive for a stationary point x=ax=a where f(a)=0f^{\prime \prime}(a)=0, we need to use another test. The higher-order derivative test (also referred to as the general derivative test) can help us identify whether a function's critical points are maxima, minima, or inflection points. Note the slight subtlety in the definitions of critical and stationary points. All stationary points are critical points but the reverse is not true. A critical point x=ax=a occurs if f(a)f(a) exists and wherever either f(a)=0f^{\prime}(a)=0 or f(a)f^{\prime}(a) does not exist. If f(a)f^{\prime}(a) does not exist then, it follows that ff is not differentiable at x=ax=a and x=ax=a is a singular point (as mentioned in the discussion in the differentiation section). Further, if f(a)=0f^{\prime}(a)=0, then the critical point is a stationary point (as stated in the definition of stationary points).

Consider a function f(x)f(x) with the point x=ax=a in its domain and where x=ax=a is a stationary point. Suppose that the first nn derivatives of ff at x=ax=a are zero and the n+1n+1 derivative of ff at aa exists and it is nonzero, i.e.

f(a)==f(n)(a)=0, and f(n+1)(a)0.f^{\prime}(a)=\cdots=f^{(n)}(a)=0, \text { and } f^{(n+1)}(a) \neq 0 .

So, f(n+1)(a)f^{(n+1)}(a) is the first derivative that is nonzero-valued at the point x=ax=a. Then, we have the following possibilities:

(i) If nn is odd and f(n+1)(a)<0f^{(n+1)}(a)<0 : aa is a local maximum

(ii) If nn is odd and f(n+1)(a)>0:af^{(n+1)}(a)>0: a is a local minimum

Note that the first two cases are equivalent to the second derivative test when n=1n=1.

(iii) If nn is even and f(n+1)(a)<0:af^{(n+1)}(a)<0: a is a point of inflection and the function is decreasing there.

(iv) If nn is even and f(n+1)(a)>0:af^{(n+1)}(a)>0: a is a point of inflection and the function is increasing there.

When several derivatives of a function vanish at a point, the function becomes pretty flat there. Note that the second derivative test is mathematically equivalent to the special case of n=1n=1 in the higher-order derivative test.

For example, say we wanted to determine the stationary points and inflection points of the graph of y=x42x2y=x^{4}-2 x^{2}. Stationary points occur at f(x)=0f^{\prime}(x)=0, so:

y(x)=4x34x=4x(x21)=0,y^{\prime}(x)=4 x^{3}-4 x=4 x\left(x^{2}-1\right)=0,

giving x=0x=0 and x=±1x= \pm 1 as stationary points. The second derivative is y(x)=12x24y^{\prime \prime}(x)=12 x^{2}-4 which, when evaluated at each of the stationary points gives

y(0)=4<0,y(±1)=8>0;y^{\prime \prime}(0)=-4<0, \quad y^{\prime \prime}( \pm 1)=8>0 ;

according to the second derivative test, x=0x=0 is a local maximum and x=±1x= \pm 1 are local minima. Further, y(x)=0y^{\prime \prime}(x)=0 at x=±1/3x= \pm 1 / \sqrt{3} and y(±1/3)0y^{\prime \prime \prime}( \pm 1 / \sqrt{3}) \neq 0. Since y(±1/3)=0y^{\prime \prime}( \pm 1 / \sqrt{3})=0 and y(±1/3)0y^{\prime \prime \prime}( \pm 1 / \sqrt{3}) \neq 0, the points x±1/3x \pm 1 / \sqrt{3} are points of inflection. Note however that since y(±1/3)0y^{\prime}( \pm 1 / \sqrt{3}) \neq 0, these are not stationary points.

Global extrema

So far we have talked about local minima and maxima. We require that a point aa is a local maximum (minimum) relative to some open interval of xx 's around x=ax=a. That is to say that there may be larger (smaller) values somewhere else in the domain but local (i.e. very close) to x=a,f(a)x=a, f(a) is larger (smaller) than all other values that ff can take.

At a global maximum (minimum), f(a)f(a) is the largest (smallest) value ff can take. We illustrate the different types of extrema using the graph of a function y=f(x)y=f(x):

Local and global extrema

The function has 3 stationary points at x=4,1x=-4,-1, and 1 . The point at (4,y1)\left(-4, y_{1}\right) is a local minimum since f(4)f(-4) is smaller than ff at some xx in the neighbourhood of x=4x=-4 (i.e. very close to x=4x=-4, on both sides). Additionally, the point (1,y2)\left(-1, y_{2}\right) is also a local minimum since f(1)f(1) is smaller than ff at some xx in the neighbourhood of x=1x=1. Since f(4)f(-4) is the smallest value ff can take in the domain in which ff is defined, we also refer to (4,y1)\left(-4, y_{1}\right) as a global minimum. There exists only one maximum at (1,y3)\left(-1, y_{3}\right) and it is both a local and global maximum.