mathworld.wolfram.com

Central Limit Theorem -- from Wolfram MathWorld

  • ️Weisstein, Eric W.
Algebra Applied Mathematics Calculus and Analysis Discrete Mathematics Foundations of Mathematics Geometry History and Terminology Number Theory Probability and Statistics Recreational Mathematics Topology Alphabetical Index New in MathWorld

Let X_1,X_2,...,X_N be a set of N independent random variates and each X_i have an arbitrary probability distribution P(x_1,...,x_N) with mean mu_i and a finite variance sigma_i^2. Then the normal form variate

X_(norm)=(sum_(i=1)^(N)x_i-sum_(i=1)^(N)mu_i)/(sqrt(sum_(i=1)^(N)sigma_i^2))

(1)

has a limiting cumulative distribution function which approaches a normal distribution.

Under additional conditions on the distribution of the addend, the probability density itself is also normal (Feller 1971) with mean mu=0 and variance sigma^2=1. If conversion to normal form is not performed, then the variate

X=1/Nsum_(i=1)^Nx_i

(2)

is normally distributed with mu_X=mu_x and sigma_X=sigma_x/sqrt(N).

Kallenberg (1997) gives a six-line proof of the central limit theorem. For an elementary, but slightly more cumbersome proof of the central limit theorem, consider the inverse Fourier transform of P_X(f).

Now write

<X^n>=<N^(-n)(x_1+x_2+...+x_N)^n> =int_(-infty)^inftyN^(-n)(x_1+...+x_N)^nP(x_1)...P(x_N)dx_1...dx_N,

(7)

so we have

Now expand

ln(1+x)=x-1/2x^2+1/3x^3+...,

(17)

so

since

Taking the Fourier transform,

This is of the form

int_(-infty)^inftye^(iaf-bf^2)df,

(25)

where a=2pi(mu_x-x) and b=(2pisigma_x)^2/2N. But this is a Fourier transform of a Gaussian function, so

int_(-infty)^inftye^(iaf-bf^2)df=e^(-a^2/4b)sqrt(pi/b)

(26)

(e.g., Abramowitz and Stegun 1972, p. 302, equation 7.4.6). Therefore,

But sigma_X=sigma_x/sqrt(N) and mu_X=mu_x, so

P_X=1/(sigma_Xsqrt(2pi))e^(-(mu_X-x)^2/2sigma_X^2).

(30)

The "fuzzy" central limit theorem says that data which are influenced by many small and unrelated random effects are approximately normally distributed.

See also

Berry-Esséen Theorem, Fourier Transform--Gaussian, Lindeberg Condition, Lindeberg-Feller Central Limit Theorem, Lyapunov Condition Explore this topic in the MathWorld classroom

Explore with Wolfram|Alpha

References

Abramowitz, M. and Stegun, I. A. (Eds.). Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables, 9th printing. New York: Dover, 1972.Feller, W. "The Fundamental Limit Theorems in Probability." Bull. Amer. Math. Soc. 51, 800-832, 1945.Feller, W. An Introduction to Probability Theory and Its Applications, Vol. 1, 3rd ed. New York: Wiley, p. 229, 1968.Feller, W. An Introduction to Probability Theory and Its Applications, Vol. 2, 3rd ed. New York: Wiley, 1971.Kallenberg, O. Foundations of Modern Probability. New York: Springer-Verlag, 1997.Lindeberg, J. W. "Eine neue Herleitung des Exponentialgesetzes in der Wahrscheinlichkeitsrechnung." Math. Z. 15, 211-225, 1922.Spiegel, M. R. Theory and Problems of Probability and Statistics. New York: McGraw-Hill, pp. 112-113, 1992.Trotter, H. F. "An Elementary Proof of the Central Limit Theorem." Arch. Math. 10, 226-234, 1959.Zabell, S. L. "Alan Turing and the Central Limit Theorem." Amer. Math. Monthly 102, 483-494, 1995.

Referenced on Wolfram|Alpha

Central Limit Theorem

Cite this as:

Weisstein, Eric W. "Central Limit Theorem." From MathWorld--A Wolfram Web Resource. https://mathworld.wolfram.com/CentralLimitTheorem.html

Subject classifications