Supremum & Infimum

Basis
Last updated: Tags: Analysis, Real Numbers

You know that R\mathbb{R} is complete — every Cauchy sequence converges. But completeness has an equivalent face that is often more convenient in practice: every non-empty set of reals that is bounded above has a smallest upper bound. That bound is called the supremum, and its mirror image for lower bounds is the infimum. These two concepts underpin the entire structure of real analysis.

Bounds

Let SRS \subseteq \mathbb{R} be a non-empty set.

A number MRM \in \mathbb{R} is an upper bound of SS if

sS,sM.\forall s \in S,\quad s \leq M.

A number mRm \in \mathbb{R} is a lower bound of SS if

sS,ms.\forall s \in S,\quad m \leq s.

If SS has at least one upper bound it is bounded above; if it has at least one lower bound it is bounded below. A set that is bounded above and below is simply called bounded.

Note that bounds are not unique. If MM is an upper bound of SS, so is M+1M + 1, M+100M + 100, and any larger number. The interesting object is the tightest bound.

Supremum and infimum

The supremum of SS, written supS\sup S, is the least upper bound of SS: it is an upper bound of SS and is \leq every other upper bound of SS.

Unpacking the definition: supS=α\sup S = \alpha means

  1. sS,  sα\forall s \in S,\; s \leq \alpha (upper bound), and
  2. ε>0,  sS such that s>αε\forall \varepsilon > 0,\; \exists\, s \in S \text{ such that } s > \alpha - \varepsilon (no smaller upper bound works).

Condition 2 is the characteristic property of the supremum: you cannot lower α\alpha by even ε\varepsilon without losing the upper-bound property.

The infimum of SS, written infS\inf S, is the greatest lower bound of SS: it is a lower bound of SS and is \geq every other lower bound. Dually, infS=β\inf S = \beta means

  1. sS,  βs\forall s \in S,\; \beta \leq s, and
  2. ε>0,  sS such that s<β+ε\forall \varepsilon > 0,\; \exists\, s \in S \text{ such that } s < \beta + \varepsilon.

Both supS\sup S and infS\inf S are unique when they exist: if α\alpha and α\alpha' are both least upper bounds then αα\alpha \leq \alpha' and αα\alpha' \leq \alpha, so α=α\alpha = \alpha'.

The least upper bound property

The existence of supS\sup S is not automatic — it depends on the number system. In Q\mathbb{Q}, the set {qQ:q2<2}\{q \in \mathbb{Q} : q^2 < 2\} is bounded above (by 22, for instance) yet has no supremum in Q\mathbb{Q}, because 2Q\sqrt{2} \notin \mathbb{Q}.

In R\mathbb{R}, the situation is perfect:

Theorem (Least Upper Bound Property). Every non-empty subset of R\mathbb{R} that is bounded above has a supremum in R\mathbb{R}.

Proof sketch. Because R\mathbb{R} is complete, every Cauchy sequence of reals converges in R\mathbb{R}. From completeness one can show: for a non-empty SS bounded above, consider the binary search sequence that tightens an interval [an,bn][a_n, b_n] where anSa_n \in S (or near SS) and bnb_n is always an upper bound. The interval lengths shrink to zero, so the endpoints form Cauchy sequences converging to a common limit, which is the supremum. \square

By symmetry (negate all elements), every non-empty subset bounded below has an infimum in R\mathbb{R}.

The least upper bound property is logically equivalent to the completeness of R\mathbb{R}: either can be taken as the defining axiom and the other derived. Together they express the same fact — R\mathbb{R} has no holes.

Examples

Closed interval [a,b][a, b]

sup[a,b]=b,inf[a,b]=a.\sup [a, b] = b, \qquad \inf [a, b] = a.

Both bounds are attained: b[a,b]b \in [a, b] and a[a,b]a \in [a, b].

Open interval (a,b)(a, b)

sup(a,b)=b,inf(a,b)=a.\sup (a, b) = b, \qquad \inf (a, b) = a.

Neither bound is attained: b(a,b)b \notin (a, b) and a(a,b)a \notin (a, b). The supremum exists in R\mathbb{R} even though no element of the set reaches it — the set approaches bb arbitrarily closely but never touches it.

Harmonic sequence

Let S={1n:nN,  n1}={1,12,13,}S = \left\{\dfrac{1}{n} : n \in \mathbb{N},\; n \geq 1\right\} = \left\{1,\, \tfrac{1}{2},\, \tfrac{1}{3},\, \ldots\right\}.

supS=1S,infS=0S.\sup S = 1 \in S, \qquad \inf S = 0 \notin S.

The infimum 00 is not achieved: every element 1/n>01/n > 0, but for any ε>0\varepsilon > 0 you can choose n>1/εn > 1/\varepsilon to get 1/n<ε1/n < \varepsilon, confirming 00 is the greatest lower bound.

Unbounded sets

The set N\mathbb{N} is bounded below (infN=0\inf \mathbb{N} = 0) but unbounded above: no finite MM is an upper bound, so supN\sup \mathbb{N} does not exist in R\mathbb{R}. It is conventional to write supN=+\sup \mathbb{N} = +\infty.

Sup and inf in the set vs outside it

A key insight from the examples: the supremum of SS may or may not belong to SS.

  • supSS\sup S \in S if and only if SS has a maximum (greatest element).
  • infSS\inf S \in S if and only if SS has a minimum (least element).

Every set has at most one maximum and one minimum; if either exists it equals the corresponding sup or inf. But a set can have a supremum without having a maximum — as (a,b)(a, b) illustrates.

The Archimedean property

A classical consequence of the least upper bound property is:

Theorem (Archimedean property). For every xRx \in \mathbb{R}, there exists nNn \in \mathbb{N} with n>xn > x.

Proof. Suppose for contradiction that some xRx \in \mathbb{R} is an upper bound for N\mathbb{N}. Then N\mathbb{N} is a non-empty bounded-above subset of R\mathbb{R}, so by the LUB property it has a supremum α=supN\alpha = \sup \mathbb{N}. Since α1\alpha - 1 is not an upper bound of N\mathbb{N}, there exists nNn \in \mathbb{N} with n>α1n > \alpha - 1, i.e.\ n+1>αn + 1 > \alpha. But n+1Nn + 1 \in \mathbb{N}, contradicting α\alpha being an upper bound. \square

An equivalent formulation: for any ε>0\varepsilon > 0, there exists nNn \in \mathbb{N} with 1/n<ε1/n < \varepsilon. This is used constantly in analysis to show that quantities can be made arbitrarily small.

Useful reformulations

The following are all equivalent to α=supS\alpha = \sup S, and each is useful in different proofs:

  • α\alpha is an upper bound, and for every ε>0\varepsilon > 0 the interval (αε,α](\alpha - \varepsilon, \alpha] contains a point of SS.
  • α\alpha is an upper bound, and there is a sequence (sn)(s_n) in SS with snαs_n \to \alpha.
  • α=min{MR:M is an upper bound of S}\alpha = \min\{M \in \mathbb{R} : M \text{ is an upper bound of } S\}.

The second reformulation — a sequence in SS converging to the supremum — is often the most useful in proofs, connecting the sup/inf language back to sequences and limits.

Summary

  • An upper bound of SS satisfies sMs \leq M for all sSs \in S; a lower bound satisfies msm \leq s for all sSs \in S.
  • The supremum supS\sup S is the least upper bound; the infimum infS\inf S is the greatest lower bound. Both are unique when they exist.
  • The characterisation: α=supS\alpha = \sup S iff α\alpha is an upper bound and for every ε>0\varepsilon > 0 some sSs \in S satisfies s>αεs > \alpha - \varepsilon.
  • The least upper bound property: every non-empty SRS \subseteq \mathbb{R} bounded above has supSR\sup S \in \mathbb{R}. This is equivalent to the completeness of R\mathbb{R}.
  • The supremum may or may not lie in SS: supSS\sup S \in S iff SS has a maximum.
  • The Archimedean property follows: for any xRx \in \mathbb{R} there exists nNn \in \mathbb{N} with n>xn > x, so N\mathbb{N} is unbounded above and 1/n1/n can be made arbitrarily small.