Uniform continuity

In mathematics, a real function $f$ of real numbers is said to be uniformly continuous if there is a positive real number $\delta$ such that function values over any function domain interval of the size $\delta$ are as close to each other as we want. In other words, for a uniformly continuous real function of real numbers, if we want function value differences to be less than any positive real number $\epsilon$ , then there is a positive real number $\delta$ such that $|f(x)-f(y)|<\epsilon$ at any $x$ and $y$ in any function interval of the size $\delta$ .

As the center of the blue window, with real height

2\varepsilon \in \mathbb {R} _{>0}

and real width

2\delta \in \mathbb {R} _{>0}

, moves over the graph of

f(x)={\tfrac {1}{x}}

in the direction of

x=0

, there comes a point at which the graph of

f

penetrates the (interior of the) top and/or bottom of that window. This means that

f

ranges over an interval larger than or equal to

\varepsilon

over an

x

-interval smaller than

\delta

. If there existed a window whereof top and/or bottom is never penetrated by the graph of

f

as the window moves along it over its domain, then that window's width would need to be infinitesimally small (nonreal), meaning that

f(x)

is not uniformly continuous. The function

g(x)={\sqrt {x}}

, on the other hand, is uniformly continuous.

The difference between uniform continuity and (ordinary) continuity is that, in uniform continuity there is a globally applicable $\delta$ (the size of a function domain interval over which function value differences are less than $\epsilon$ ) that depends on only $\varepsilon$ , while in (ordinary) continuity there is a locally applicable $\delta$ that depends on the both $\varepsilon$ and $x$ . So uniform continuity is a stronger continuity condition than continuity; a function that is uniformly continuous is continuous but a function that is continuous is not necessarily uniformly continuous. The concepts of uniform continuity and continuity can be expanded to functions defined between metric spaces.

Continuous functions can fail to be uniformly continuous if they are unbounded on a bounded domain, such as $f(x)={\tfrac {1}{x}}$ on $(0,1)$ , or if their slopes become unbounded on an infinite domain, such as $f(x)=x^{2}$ on the real (number) line. However, any Lipschitz map between metric spaces is uniformly continuous, in particular any isometry (distance-preserving map).

Although continuity can be defined for functions between general topological spaces, defining uniform continuity requires more structure. The concept relies on comparing the sizes of neighbourhoods of distinct points, so it requires a metric space, or more generally a uniform space.

Definition for functions on metric spaces

For a function $f:X\to Y$ with metric spaces $(X,d_{1})$ and $(Y,d_{2})$ , the following definitions of uniform continuity and (ordinary) continuity hold.

Definition of uniform continuity

$f$ $f$ is called uniformly continuous if for every real number $\varepsilon >0$ $\varepsilon >0$ there exists a real number $\delta >0$ $\delta > 0$ such that for every $x,y\in X$ $x,y\in X$ with $d_{1}(x,y)<\delta$ $d_{1}(x,y)<\delta$ , we have $d_{2}(f(x),f(y))<\varepsilon$ $d_{2}(f(x),f(y))<\varepsilon$ . The set $\{y\in X:d_{1}(x,y)<\delta \}$ $\{y\in X:d_{1}(x,y)<\delta \}$ for each $x$ $x$ is a neighbourhood of $x$ $x$ and the set $\{x\in X:d_{1}(x,y)<\delta \}$ $\{x\in X:d_{1}(x,y)<\delta \}$ for each $y$ $y$ is a neighbourhood of $y$ $y$ by the definition of a neighbourhood in a metric space.
- If $X$ and $Y$ are subsets of the real line, then $d_{1}$ and $d_{2}$ can be the standard one-dimensional Euclidean distance, yielding the following definition: for every real number $\varepsilon >0$ there exists a real number $\delta >0$ such that for every $x,y\in X$ , $|x-y|<\delta \implies |f(x)-f(y)|<\varepsilon$ (where $A\implies B$ is a material conditional statement saying "if $A$ , then $B$ ").
Equivalently, $f$ is said to be uniformly continuous if $\forall \varepsilon >0\;\exists \delta >0\;\forall x\in X\;\forall y\in X:\,d_{1}(x,y)<\delta \,\Rightarrow \,d_{2}(f(x),f(y))<\varepsilon$ . Here quantifications ( $\forall \varepsilon >0$ , $\exists \delta >0$ , $\forall x\in X$ , and $\forall y\in X$ ) are used.
Alternatively, $f$ is said to be uniformly continuous if there is a function of all positive real numbers $\varepsilon$ , $\delta (\varepsilon )$ representing the maximum positive real number, such that for every $x,y\in X$ if $d_{1}(x,y)<\delta (\varepsilon )$ then $d_{2}(f(x),f(y))<\varepsilon$ . $\delta (\varepsilon )$ is a monotonically non-decreasing function.

Definition of (ordinary) continuity

$f$ is called continuous ${\underline {{\text{at }}x}}$ if for every real number $\varepsilon >0$ there exists a real number $\delta >0$ such that for every $y\in X$ with $d_{1}(x,y)<\delta$ , we have $d_{2}(f(x),f(y))<\varepsilon$ . The set $\{y\in X:d_{1}(x,y)<\delta \}$ is a neighbourhood of $x$ . Thus, (ordinary) continuity is a local property of the function at the point $x$ .
Equivalently, a function $f$ is said to be continuous if $\forall x\in X\;\forall \varepsilon >0\;\exists \delta >0\;\forall y\in X:\,d_{1}(x,y)<\delta \,\Rightarrow \,d_{2}(f(x),f(y))<\varepsilon$ .
Alternatively, a function $f$ is said to be continuous if there is a function of all positive real numbers $\varepsilon$ and $x\in X$ , $\delta (\varepsilon ,x)$ representing the maximum positive real number, such that at each $x$ if $y\in X$ satisfies $d_{1}(x,y)<\delta (\varepsilon ,x)$ then $d_{2}(f(x),f(y))<\varepsilon$ . At every $x$ , $\delta (\varepsilon ,x)$ is a monotonically non-decreasing function.

Local continuity versus global uniform continuity

In the definitions, the difference between uniform continuity and continuity is that, in uniform continuity there is a globally applicable $\delta$ (the size of a neighbourhood in $X$ over which values of the metric for function values in $Y$ are less than $\varepsilon$ ) that depends on only $\varepsilon$ while in continuity there is a locally applicable $\delta$ that depends on the both $\varepsilon$ and $x$ . Continuity is a local property of a function — that is, a function $f$ is continuous, or not, at a particular point $x$ of the function domain $X$ , and this can be determined by looking at only the values of the function in an arbitrarily small neighbourhood of that point. When we speak of a function being continuous on an interval, we mean that the function is continuous at every point of the interval. In contrast, uniform continuity is a global property of $f$ , in the sense that the standard definition of uniform continuity refers to every point of $X$ . On the other hand, it is possible to give a definition that is local in terms of the natural extension $f^{*}$ (the characteristics of which at nonstandard points are determined by the global properties of $f$ ), although it is not possible to give a local definition of uniform continuity for an arbitrary hyperreal-valued function, see below.

A mathematical definition that a function $f$ is continuous on an interval $I$ and a definition that $f$ is uniformly continuous on $I$ are structurally similar as shown in the following.

Continuity of a function $f:X\to Y$ for metric spaces $(X,d_{1})$ and $(Y,d_{2})$ at every point $x$ of an interval $I\subseteq X$ (i.e., continuity of $f$ on the interval $I$ ) is expressed by a formula starting with quantifications

\forall x\in I\;\forall \varepsilon >0\;\exists \delta >0\;\forall y\in I:\,d_{1}(x,y)<\delta \,\Rightarrow \,d_{2}(f(x),f(y))<\varepsilon

,

(metrics $d_{1}(x,y)$ and $d_{2}(f(x),f(y))$ are $|x-y|$ and $|f(x)-f(y)|$ for $f:\mathbb {R} \to \mathbb {R}$ for the set of real numbers $\mathbb {R}$ ).

For uniform continuity, the order of the first, second, and third quantifications ( $\forall x\in I$ , $\forall \varepsilon >0$ , and $\exists \delta >0$ ) are rotated:

\forall \varepsilon >0\;\exists \delta >0\;\forall x\in I\;\forall y\in I:\,d_{1}(x,y)<\delta \,\Rightarrow \,d_{2}(f(x),f(y))<\varepsilon

.

Thus for continuity on the interval, one takes an arbitrary point $x$ of the interval, and then there must exist a distance $\delta$ ,

\cdots \forall x\,\exists \delta \cdots ,

while for uniform continuity, a single $\delta$ must work uniformly for all points $x$ of the interval,

\cdots \exists \delta \,\forall x\cdots .

Properties

Every uniformly continuous function is continuous, but the converse does not hold. Consider for instance the continuous function $f\colon \mathbb {R} \rightarrow \mathbb {R} ,x\mapsto x^{2}$ where $\mathbb {R}$ is the set of real numbers. Given a positive real number $\varepsilon$ , uniform continuity requires the existence of a positive real number $\delta$ such that for all $x_{1},x_{2}\in \mathbb {R}$ with $|x_{1}-x_{2}|<\delta$ , we have $|f(x_{1})-f(x_{2})|<\varepsilon$ . But

f\left(x+\delta \right)-f(x)=2x\cdot \delta +\delta ^{2},

and as $x$ goes to be a higher and higher value, $\delta$ needs to be lower and lower to satisfy $|f(x+\beta )-f(x)|<\varepsilon$ for positive real numbers $\beta <\delta$ and the given $\varepsilon$ . This means that there is no specifiable (no matter how small it is) positive real number $\delta$ to satisfy the condition for $f$ to be uniformly continuous so $f$ is not uniformly continuous.

Any absolutely continuous function (over a compact interval) is uniformly continuous. On the other hand, the Cantor function is uniformly continuous but not absolutely continuous.

The image of a totally bounded subset under a uniformly continuous function is totally bounded. However, the image of a bounded subset of an arbitrary metric space under a uniformly continuous function need not be bounded: as a counterexample, consider the identity function from the integers endowed with the discrete metric to the integers endowed with the usual Euclidean metric.

The Heine–Cantor theorem asserts that every continuous function on a compact set is uniformly continuous. In particular, if a function is continuous on a closed bounded interval of the real line, it is uniformly continuous on that interval. The Darboux integrability of continuous functions follows almost immediately from this theorem.

If a real-valued function $f$ is continuous on $[0,\infty )$ and $\lim _{x\to \infty }f(x)$ exists (and is finite), then $f$ is uniformly continuous. In particular, every element of $C_{0}(\mathbb {R} )$ , the space of continuous functions on $\mathbb {R}$ that vanish at infinity, is uniformly continuous. This is a generalization of the Heine-Cantor theorem mentioned above, since $C_{c}(\mathbb {R} )\subset C_{0}(\mathbb {R} )$ .

Examples and nonexamples

Examples

Linear functions $x\mapsto ax+b$ are the simplest examples of uniformly continuous functions.
Any continuous function on the interval $[0,1]$ is also uniformly continuous, since $[0,1]$ is a compact set.
If a function is differentiable on an open interval and its derivative is bounded, then the function is uniformly continuous on that interval.
Every Lipschitz continuous map between two metric spaces is uniformly continuous. More generally, every Hölder continuous function is uniformly continuous.
The absolute value function is uniformly continuous, despite not being differentiable at $x=0$ . This shows uniformly continuous functions are not always differentiable.
Despite being nowhere differentiable, the Weierstrass function is uniformly continuous.
Every member of a uniformly equicontinuous set of functions is uniformly continuous.

Nonexamples

Functions that are unbounded on a bounded domain are not uniformly continuous. The tangent function is continuous on the interval $(-\pi /2,\pi /2)$ but is not uniformly continuous on that interval, as it goes to infinity as $x\to \pi /2$ .
Functions whose derivative tends to infinity as $x$ grows large cannot be uniformly continuous. The exponential function $x\mapsto e^{x}$ is continuous everywhere on the real line but is not uniformly continuous on the line, since its derivative is $e^{x}$ , and $e^{x}\to \infty$ as $x\to \infty$ .

Visualization

For a uniformly continuous function, for every positive real number $\varepsilon >0$ there is a positive real number $\delta >0$ such that two function values $f(x)$ and $f(y)$ have the maximum distance $\varepsilon$ whenever $x$ and $y$ are within the maximum distance $\delta$ . Thus at each point $(x,f(x))$ of the graph, if we draw a rectangle with a height slightly less than $2\varepsilon$ and width a slightly less than $2\delta$ around that point, then the graph lies completely within the height of the rectangle, i.e., the graph do not pass through the top or the bottom side of the rectangle. For functions that are not uniformly continuous, this isn't possible; for these functions, the graph might lie inside the height of the rectangle at some point on the graph but there is a point on the graph where the graph lies above or below the rectangle. (the graph penetrates the top or bottom side of the rectangle.)

$For uniformly continuous functions, for each positive real number ε > 0 {\displaystyle \varepsilon >0} there is a positive real number δ > 0 {\displaystyle \delta >0} such that when we draw a rectangle around each point of the graph with a width slightly less than 2 δ {\displaystyle 2\delta } and a height slightly less than 2 ε {\displaystyle 2\varepsilon } , the graph lies completely inside the height of the rectangle.$
For uniformly continuous functions, for each positive real number $\varepsilon >0$ there is a positive real number $\delta >0$ such that when we draw a rectangle around each point of the graph with a width slightly less than $2\delta$ and a height slightly less than $2\varepsilon$ , the graph lies completely inside the height of the rectangle.
$For functions that are not uniformly continuous, there is a positive real number ε > 0 {\displaystyle \varepsilon >0} such that for every positive real number δ > 0 {\displaystyle \delta >0} there is a point on the graph so that when we draw a rectangle with a height slightly less than 2 ε {\displaystyle 2\varepsilon } and a width slightly less than 2 δ {\displaystyle 2\delta } around that point, there is a function value directly above or below the rectangle. There might be a graph point where the graph is completely inside the height of the rectangle but this is not true for every point of the graph.$
For functions that are not uniformly continuous, there is a positive real number $\varepsilon >0$ such that for every positive real number $\delta >0$ there is a point on the graph so that when we draw a rectangle with a height slightly less than $2\varepsilon$ and a width slightly less than $2\delta$ around that point, there is a function value directly above or below the rectangle. There might be a graph point where the graph is completely inside the height of the rectangle but this is not true for every point of the graph.

History

The first published definition of uniform continuity was by Heine in 1870, and in 1872 he published a proof that a continuous function on an open interval need not be uniformly continuous. The proofs are almost verbatim given by Dirichlet in his lectures on definite integrals in 1854. The definition of uniform continuity appears earlier in the work of Bolzano where he also proved that continuous functions on an open interval do not need to be uniformly continuous. In addition he also states that a continuous function on a closed interval is uniformly continuous, but he does not give a complete proof.[1]

Other characterizations

Non-standard analysis

In non-standard analysis, a real-valued function $f$ of a real variable is microcontinuous at a point $a$ precisely if the difference $f^{*}(a+\delta )-f^{*}(a)$ is infinitesimal whenever $\delta$ is infinitesimal. Thus $f$ is continuous on a set $A$ in $\mathbb {R}$ precisely if $f^{*}$ is microcontinuous at every real point $a\in A$ . Uniform continuity can be expressed as the condition that (the natural extension of) $f$ is microcontinuous not only at real points in $A$ , but at all points in its non-standard counterpart (natural extension) $^{*}A$ in $^{*}\mathbb {R}$ . Note that there exist hyperreal-valued functions which meet this criterion but are not uniformly continuous, as well as uniformly continuous hyperreal-valued functions which do not meet this criterion, however, such functions cannot be expressed in the form $f^{*}$ for any real-valued function $f$ . (see non-standard calculus for more details and examples).

Cauchy continuity

For a function between metric spaces, uniform continuity implies Cauchy continuity (Fitzpatrick 2006). More specifically, let $A$ be a subset of $\mathbb {R} ^{n}$ . If a function $f:A\to \mathbb {R} ^{n}$ is uniformly continuous then for every pair of sequences $x_{n}$ and $y_{n}$ such that

\lim _{n\to \infty }|x_{n}-y_{n}|=0

we have

\lim _{n\to \infty }|f(x_{n})-f(y_{n})|=0.

Relations with the extension problem

Let $X$ be a metric space, $S$ a subset of $X$ , $R$ a complete metric space, and $f:S\rightarrow R$ a continuous function. A question to answer: When can $f$ be extended to a continuous function on all of $X$ ?

If $S$ is closed in $X$ , the answer is given by the Tietze extension theorem. So it is necessary and sufficient to extend $f$ to the closure of $S$ in $X$ : that is, we may assume without loss of generality that $S$ is dense in $X$ , and this has the further pleasant consequence that if the extension exists, it is unique. A sufficient condition for $f$ to extend to a continuous function $f:X\rightarrow R$ is that it is Cauchy-continuous, i.e., the image under $f$ of a Cauchy sequence remains Cauchy. If $X$ is complete (and thus the completion of $S$ ), then every continuous function from $X$ to a metric space $Y$ is Cauchy-continuous. Therefore when $X$ is complete, $f$ extends to a continuous function $f:X\rightarrow R$ if and only if $f$ is Cauchy-continuous.

It is easy to see that every uniformly continuous function is Cauchy-continuous and thus extends to $X$ . The converse does not hold, since the function $f:R\rightarrow R,x\mapsto x^{2}$ is, as seen above, not uniformly continuous, but it is continuous and thus Cauchy continuous. In general, for functions defined on unbounded spaces like $R$ , uniform continuity is a rather strong condition. It is desirable to have a weaker condition from which to deduce extendability.

For example, suppose $a>1$ is a real number. At the precalculus level, the function $f:x\mapsto a^{x}$ can be given a precise definition only for rational values of $x$ (assuming the existence of qth roots of positive real numbers, an application of the Intermediate Value Theorem). One would like to extend $f$ to a function defined on all of $R$ . The identity

f(x+\delta )-f(x)=a^{x}\left(a^{\delta }-1\right)

shows that $f$ is not uniformly continuous on the set $Q$ of all rational numbers; however for any bounded interval $I$ the restriction of $f$ to $Q\cap I$ is uniformly continuous, hence Cauchy-continuous, hence $f$ extends to a continuous function on $I$ . But since this holds for every $I$ , there is then a unique extension of $f$ to a continuous function on all of $R$ .

More generally, a continuous function $f:S\rightarrow R$ whose restriction to every bounded subset of $S$ is uniformly continuous is extendable to $X$ , and the converse holds if $X$ is locally compact.

A typical application of the extendability of a uniformly continuous function is the proof of the inverse Fourier transformation formula. We first prove that the formula is true for test functions, there are densely many of them. We then extend the inverse map to the whole space using the fact that linear map is continuous; thus, uniformly continuous.

Generalization to topological vector spaces

In the special case of two topological vector spaces $V$ and $W$ , the notion of uniform continuity of a map $f:V\to W$ becomes: for any neighborhood $B$ of zero in $W$ , there exists a neighborhood $A$ of zero in $V$ such that $v_{1}-v_{2}\in A$ implies $f(v_{1})-f(v_{2})\in B.$

For linear transformations $f:V\to W$ , uniform continuity is equivalent to continuity. This fact is frequently used implicitly in functional analysis to extend a linear map off a dense subspace of a Banach space.

Generalization to uniform spaces

Just as the most natural and general setting for continuity is topological spaces, the most natural and general setting for the study of uniform continuity are the uniform spaces. A function $f:X\to Y$ between uniform spaces is called uniformly continuous if for every entourage $V$ in $Y$ there exists an entourage $U$ in $X$ such that for every $(x_{1},x_{2})$ in $U$ we have $(f(x_{1}),f(x_{2}))$ in $V$ .

In this setting, it is also true that uniformly continuous maps transform Cauchy sequences into Cauchy sequences.

Each compact Hausdorff space possesses exactly one uniform structure compatible with the topology. A consequence is a generalization of the Heine-Cantor theorem: each continuous function from a compact Hausdorff space to a uniform space is uniformly continuous.

References

Rusnock & Kerr-Lawson 2005.