Supremum & Infimum

Basis
Last updated: Tags: Analysis, Real Numbers

You know that R\mathbb{R} is complete — every Cauchy sequence converges. But completeness has an equivalent face that is often more convenient in practice: every non-empty set of reals that is bounded above has a smallest upper bound. That bound is called the supremum, and its mirror image for lower bounds is the infimum. These two concepts underpin the entire structure of real analysis.

Bounds

Let S⊆RS \subseteq \mathbb{R} be a non-empty set.

A number M∈RM \in \mathbb{R} is an upper bound of SS if

∀s∈S,s≤M.\forall s \in S,\quad s \leq M.

A number m∈Rm \in \mathbb{R} is a lower bound of SS if

∀s∈S,m≤s.\forall s \in S,\quad m \leq s.

If SS has at least one upper bound it is bounded above; if it has at least one lower bound it is bounded below. A set that is bounded above and below is simply called bounded.

Note that bounds are not unique. If MM is an upper bound of SS, so is M+1M + 1, M+100M + 100, and any larger number. The interesting object is the tightest bound.

Supremum and infimum

The supremum of SS, written sup⁡S\sup S, is the least upper bound of SS: it is an upper bound of SS and is ≤\leq every other upper bound of SS.

Unpacking the definition: sup⁡S=α\sup S = \alpha means

  1. ∀s∈S,  s≤α\forall s \in S,\; s \leq \alpha (upper bound), and
  2. ∀ε>0,  ∃ s∈S such that s>α−ε\forall \varepsilon > 0,\; \exists\, s \in S \text{ such that } s > \alpha - \varepsilon (no smaller upper bound works).

Condition 2 is the characteristic property of the supremum: you cannot lower α\alpha by even ε\varepsilon without losing the upper-bound property.

The infimum of SS, written inf⁡S\inf S, is the greatest lower bound of SS: it is a lower bound of SS and is ≥\geq every other lower bound. Dually, inf⁡S=β\inf S = \beta means

  1. ∀s∈S,  β≤s\forall s \in S,\; \beta \leq s, and
  2. ∀ε>0,  ∃ s∈S such that s<β+ε\forall \varepsilon > 0,\; \exists\, s \in S \text{ such that } s < \beta + \varepsilon.

Both sup⁡S\sup S and inf⁡S\inf S are unique when they exist: if α\alpha and α′\alpha' are both least upper bounds then α≤α′\alpha \leq \alpha' and α′≤α\alpha' \leq \alpha, so α=α′\alpha = \alpha'.

The least upper bound property

The existence of sup⁡S\sup S is not automatic — it depends on the number system. In Q\mathbb{Q}, the set {q∈Q:q2<2}\{q \in \mathbb{Q} : q^2 < 2\} is bounded above (by 22, for instance) yet has no supremum in Q\mathbb{Q}, because 2∉Q\sqrt{2} \notin \mathbb{Q}.

In R\mathbb{R}, the situation is perfect:

Theorem (Least Upper Bound Property). Every non-empty subset of R\mathbb{R} that is bounded above has a supremum in R\mathbb{R}.

Proof sketch. Because R\mathbb{R} is complete, every Cauchy sequence of reals converges in R\mathbb{R}. From completeness one can show: for a non-empty SS bounded above, consider the binary search sequence that tightens an interval [an,bn][a_n, b_n] where an∈Sa_n \in S (or near SS) and bnb_n is always an upper bound. The interval lengths shrink to zero, so the endpoints form Cauchy sequences converging to a common limit, which is the supremum. □\square

By symmetry (negate all elements), every non-empty subset bounded below has an infimum in R\mathbb{R}.

The least upper bound property is logically equivalent to the completeness of R\mathbb{R}: either can be taken as the defining axiom and the other derived. Together they express the same fact — R\mathbb{R} has no holes.

Examples

Closed interval [a,b][a, b]

sup⁡[a,b]=b,inf⁡[a,b]=a.\sup [a, b] = b, \qquad \inf [a, b] = a.

Both bounds are attained: b∈[a,b]b \in [a, b] and a∈[a,b]a \in [a, b].

Open interval (a,b)(a, b)

sup⁡(a,b)=b,inf⁡(a,b)=a.\sup (a, b) = b, \qquad \inf (a, b) = a.

Neither bound is attained: b∉(a,b)b \notin (a, b) and a∉(a,b)a \notin (a, b). The supremum exists in R\mathbb{R} even though no element of the set reaches it — the set approaches bb arbitrarily closely but never touches it.

Harmonic sequence

Let S={1n:n∈N,  n≥1}={1, 12, 13, …}S = \left\{\dfrac{1}{n} : n \in \mathbb{N},\; n \geq 1\right\} = \left\{1,\, \tfrac{1}{2},\, \tfrac{1}{3},\, \ldots\right\}.

sup⁡S=1∈S,inf⁡S=0∉S.\sup S = 1 \in S, \qquad \inf S = 0 \notin S.

The infimum 00 is not achieved: every element 1/n>01/n > 0, but for any ε>0\varepsilon > 0 you can choose n>1/εn > 1/\varepsilon to get 1/n<ε1/n < \varepsilon, confirming 00 is the greatest lower bound.

Unbounded sets

The set N\mathbb{N} is bounded below (inf⁡N=0\inf \mathbb{N} = 0) but unbounded above: no finite MM is an upper bound, so sup⁡N\sup \mathbb{N} does not exist in R\mathbb{R}. It is conventional to write sup⁡N=+∞\sup \mathbb{N} = +\infty.

Sup and inf in the set vs outside it

A key insight from the examples: the supremum of SS may or may not belong to SS.

  • sup⁡S∈S\sup S \in S if and only if SS has a maximum (greatest element).
  • inf⁡S∈S\inf S \in S if and only if SS has a minimum (least element).

Every set has at most one maximum and one minimum; if either exists it equals the corresponding sup or inf. But a set can have a supremum without having a maximum — as (a,b)(a, b) illustrates.

The Archimedean property

A classical consequence of the least upper bound property is:

Theorem (Archimedean property). For every x∈Rx \in \mathbb{R}, there exists n∈Nn \in \mathbb{N} with n>xn > x.

Proof. Suppose for contradiction that some x∈Rx \in \mathbb{R} is an upper bound for N\mathbb{N}. Then N\mathbb{N} is a non-empty bounded-above subset of R\mathbb{R}, so by the LUB property it has a supremum α=sup⁡N\alpha = \sup \mathbb{N}. Since α−1\alpha - 1 is not an upper bound of N\mathbb{N}, there exists n∈Nn \in \mathbb{N} with n>α−1n > \alpha - 1, i.e.\ n+1>αn + 1 > \alpha. But n+1∈Nn + 1 \in \mathbb{N}, contradicting α\alpha being an upper bound. □\square

An equivalent formulation: for any ε>0\varepsilon > 0, there exists n∈Nn \in \mathbb{N} with 1/n<ε1/n < \varepsilon. This is used constantly in analysis to show that quantities can be made arbitrarily small.

Useful reformulations

The following are all equivalent to α=sup⁡S\alpha = \sup S, and each is useful in different proofs:

  • α\alpha is an upper bound, and for every ε>0\varepsilon > 0 the interval (α−ε,α](\alpha - \varepsilon, \alpha] contains a point of SS.
  • α\alpha is an upper bound, and there is a sequence (sn)(s_n) in SS with sn→αs_n \to \alpha.
  • α=min⁡{M∈R:M is an upper bound of S}\alpha = \min\{M \in \mathbb{R} : M \text{ is an upper bound of } S\}.

The second reformulation — a sequence in SS converging to the supremum — is often the most useful in proofs, connecting the sup/inf language back to sequences and limits.

Summary

  • An upper bound of SS satisfies s≤Ms \leq M for all s∈Ss \in S; a lower bound satisfies m≤sm \leq s for all s∈Ss \in S.
  • The supremum sup⁡S\sup S is the least upper bound; the infimum inf⁡S\inf S is the greatest lower bound. Both are unique when they exist.
  • The characterisation: α=sup⁡S\alpha = \sup S iff α\alpha is an upper bound and for every ε>0\varepsilon > 0 some s∈Ss \in S satisfies s>α−εs > \alpha - \varepsilon.
  • The least upper bound property: every non-empty S⊆RS \subseteq \mathbb{R} bounded above has sup⁡S∈R\sup S \in \mathbb{R}. This is equivalent to the completeness of R\mathbb{R}.
  • The supremum may or may not lie in SS: sup⁡S∈S\sup S \in S iff SS has a maximum.
  • The Archimedean property follows: for any x∈Rx \in \mathbb{R} there exists n∈Nn \in \mathbb{N} with n>xn > x, so N\mathbb{N} is unbounded above and 1/n1/n can be made arbitrarily small.