Bolzano-Weierstrass Theorem

In the study of real numbers and sequences, a fundamental challenge is finding order within apparent chaos. The Bolzano-Weierstrass Theorem provides a powerful guarantee that in any bounded, possibly oscillating sequence, there exists a hidden thread of convergence. This result is not just a curious property of the real line; it is a cornerstone of mathematical analysis, underpinning proofs of continuity, compactness, and the existence of solutions in optimization and fixed-point problems. Mastering it unlocks a deeper understanding of how infinite processes behave in finite spaces.

The Core Statement and Intuition

Formally, the Bolzano-Weierstrass Theorem states: *Every bounded sequence in $\mathbb{R}$ has a convergent subsequence. Let's unpack this. A sequence* $(x_n)$ is bounded if there exists a number $M>0$ such that $|x_n|\le M$ for all $n$. This means all the terms of the sequence are trapped within the interval $[-M,M]$.

A subsequence is a sequence formed by selecting terms from the original sequence in order. For example, from $(x_1,x_2,x_3,...)$, you might take $(x_2,x_5,x_9,...)$. The theorem assures us that no matter how erratically the original bounded sequence behaves, we can always pick an infinite selection of its terms that eventually hone in on a specific limit point, called the limit of the subsequence. Visually, imagine an infinite number of points confined to a finite line segment. They must cluster somewhere; the theorem guarantees we can find an infinite cluster that converges to a single point.

Proof via the Nested Intervals Property

One classic proof elegantly uses the Nested Intervals Property of the real numbers. The strategy is a method of successive approximation, repeatedly halving an interval to trap infinitely many terms of the sequence.

Step 1: Setup. Let $(x_n)$ be our bounded sequence, contained within an initial closed interval $I_0=[a_0,b_0]$.

Step 2: Bisection. Bisect $I_0$ into two subintervals: $\left[a_0,\frac{a_0+b_0}{2}\right]$ and $\left[\frac{a_0+b_0}{2},b_0\right]$. At least one of these must contain infinitely many terms of the sequence $(x_n)$. Choose that half and call it $I_1=[a_1,b_1]$.

Step 3: Iteration. Repeat this process. Given $I_k=[a_k,b_k]$ containing infinitely many $x_n$, bisect it and choose $I_{k+1}$ as the half that again contains infinitely many terms.

Step 4: Construct the Subsequence. Now, construct the convergent subsequence. Since $I_1$ has infinitely many terms, pick an index $n_1$ such that $x_{n_1}\in I_1$. Since $I_2$ has infinitely many terms, pick an index $n_2>n_1$ such that $x_{n_2}\in I_2$. Continue inductively to get a subsequence $(x_{n_k})$ where $x_{n_k}\in I_k$ for all $k$.

Step 5: Convergence. The intervals are nested ($I_0\supseteq I_1\supseteq I_2\supseteq ...$) and their lengths shrink to zero ($b_k-a_k=(b_0-a_0)/2^k$). By the Nested Intervals Property, there is a unique point $L$ contained in all of them. Because $x_{n_k}$ and $L$ are both in $I_k$, the distance $|x_{n_k}-L|$ is at most the length of $I_k$, which goes to zero. Therefore, $x_{n_k}\to L$.

Proof via Sequential Compactness

A more modern perspective connects the theorem directly to the topological concept of compactness. A set $K$ in a metric space is sequentially compact if every sequence in $K$ has a subsequence converging to a point in $K$.

The proof in this framework is often presented in two steps that highlight a deeper property of the real numbers. First, one proves that every sequence in $\mathbb{R}$ has a monotone subsequence (this is a separate lemma). Then, the proof concludes easily: If $(x_n)$ is bounded, then any monotone subsequence of it is also bounded. By the Monotone Convergence Theorem, a bounded monotone sequence must converge. Thus, the bounded sequence $(x_n)$ has a convergent subsequence. This approach shows that closed and bounded intervals in $\mathbb{R}$ are sequentially compact, a property that is foundational for advanced analysis.

Applications and Implications

The power of the Bolzano-Weierstrass Theorem lies in its use as a tool for proving existence.

• Proving General Existence of Limits: It is frequently used in proofs by contradiction. To show a limit exists, one might assume it does not. This often implies the existence of two subsequences converging to different limits, violating the theorem's guarantee that all subsequences of a convergent sequence must converge to the same limit. It's also crucial in proving the Cauchy Criterion for convergence: in $\mathbb{R}$, a sequence is convergent if and only if it is Cauchy.
• Connection to Compactness in Metric Spaces: The theorem is the prototype for the Heine-Borel Theorem in ${\mathbb{R}}^n$, which states that a set is compact (every open cover has a finite subcover) if and only if it is closed and bounded. In the context of metric spaces, the Bolzano-Weierstrass property (every sequence has a convergent subsequence) is equivalent to sequential compactness. This equivalence is a central idea in real and functional analysis.
• Role in Optimization and Fixed-Point Arguments: The theorem is the key step in proving the Extreme Value Theorem: a continuous function on a closed, bounded interval $[a,b]$ attains its maximum and minimum. The proof involves taking a sequence of points where the function values approach the supremum, using Bolzano-Weierstrass to find a convergent subsequence of these points, and then using continuity to show the limit point is where the maximum is attained. Similar arguments underpin proofs of foundational results like the Brouwer Fixed-Point Theorem in finite dimensions.

Common Pitfalls

1. Applying to Unbounded Sequences: The theorem only applies to bounded sequences. The sequence $(1,2,3,...)$ has no convergent subsequence. Remember, boundedness is a necessary condition.
2. Misidentifying the Limit: The theorem guarantees a convergent subsequence exists, but it does not tell you what the limit is, nor does it say the original sequence converges. For example, the sequence $(0,1,0,1,...)$ is bounded. The theorem is satisfied by the constant subsequence $(0,0,0,...)$ (converging to 0) or $(1,1,1,...)$ (converging to 1), but the original sequence diverges.
3. Confusing with Completeness: The Bolzano-Weierstrass Theorem is a consequence of the completeness of the real numbers (embodied by the Nested Intervals Property or the Least Upper Bound Property). It is not true in the rational numbers $\mathbb{Q}$: a bounded sequence of rationals can have its only convergent subsequences tending to an irrational number, which lies outside $\mathbb{Q}$.
4. Overgeneralizing to All Metric Spaces: The property "every bounded sequence has a convergent subsequence" is not true in every metric space. For example, in the infinite-dimensional space of continuous functions, the unit ball is bounded but not sequentially compact. This highlights the special, finite-dimensional nature of the theorem's standard form.

Summary

• The Bolzano-Weierstrass Theorem is a foundational result in real analysis, stating that every bounded sequence of real numbers contains a convergent subsequence.
• Its proof can be constructed elegantly using the Nested Intervals Property (a form of completeness of $\mathbb{R}$) or via the lemma on monotone subsequences and the concept of sequential compactness.
• It is an essential tool for proving the existence of limits, maxima, and minima, forming the core of proofs for the Extreme Value Theorem and the Cauchy Criterion.
• The theorem establishes the critical equivalence between closed-and-bounded sets and sequential compactness in ${\mathbb{R}}^n$, a bridge between analysis and topology.
• Its failure in more general spaces (like infinite-dimensional ones) underscores the special structure of finite-dimensional Euclidean space and guides the development of functional analysis.