Power series

In mathematics, a power series (in one variable) is an infinite series of the form $\sum _{n=0}^{\infty }a_{n}\left(x-c\right)^{n}=a_{0}+a_{1}(x-c)+a_{2}(x-c)^{2}+\dots$ where a_n represents the coefficient of the nth term and c is a constant called the center of the series. Power series are useful in mathematical analysis, where they arise as Taylor series of infinitely differentiable functions. In fact, Borel's theorem implies that every power series is the Taylor series of some smooth function.

In many situations, the center c is equal to zero, for instance for Maclaurin series. In such cases, the power series takes the simpler form $\sum _{n=0}^{\infty }a_{n}x^{n}=a_{0}+a_{1}x+a_{2}x^{2}+\dots .$

The partial sums of a power series are polynomials, the partial sums of the Taylor series of an analytic function are a sequence of converging polynomial approximations to the function at the center, and a converging power series can be seen as a kind of generalized polynomial with infinitely many terms. Conversely, every polynomial is a power series with only finitely many non-zero terms.

Beyond their role in mathematical analysis, power series also occur in combinatorics as generating functions (a kind of formal power series) and in electronic engineering (under the name of the Z-transform). The familiar decimal notation for real numbers can also be viewed as an example of a power series, with integer coefficients, but with the argument x fixed at 1⁄10. In number theory, the concept of p-adic numbers is also closely related to that of a power series.

Examples

Polynomial

The exponential function (in blue), and its improving approximation by the sum of the first n + 1 terms of its Maclaurin power series (in red). So
n=0 gives

f(x)=1

,
n=1

f(x)=1+x

,
n=2

f(x)=1+x+x^{2}/2

,
n=3

f(x)=1+x+x^{2}/2+x^{3}/6

etcetera.

Every polynomial of degree $d$ can be expressed as a power series around any center $c$ , where all terms of degree higher than $d$ have a coefficient of zero.^[1] For instance, the polynomial ${\textstyle f(x)=x^{2}+2x+3}$ can be written as a power series around the center ${\textstyle c=0}$ as $f(x)=3+2x+1x^{2}+0x^{3}+0x^{4}+\cdots$ or around the center ${\textstyle c=1}$ as $f(x)=6+4(x-1)+1(x-1)^{2}+0(x-1)^{3}+0(x-1)^{4}+\cdots .$

One can view power series as being like "polynomials of infinite degree", although power series are not polynomials in the strict sense.

Geometric series, exponential function and sine

The geometric series formula ${\frac {1}{1-x}}=\sum _{n=0}^{\infty }x^{n}=1+x+x^{2}+x^{3}+\cdots ,$ which is valid for ${\textstyle |x|<1}$ , is one of the most important examples of a power series, as are the exponential function formula $e^{x}=\sum _{n=0}^{\infty }{\frac {x^{n}}{n!}}=1+x+{\frac {x^{2}}{2!}}+{\frac {x^{3}}{3!}}+\cdots$ and the sine formula $\sin(x)=\sum _{n=0}^{\infty }{\frac {(-1)^{n}x^{2n+1}}{(2n+1)!}}=x-{\frac {x^{3}}{3!}}+{\frac {x^{5}}{5!}}-{\frac {x^{7}}{7!}}+\cdots ,$ valid for all real x. These power series are examples of Taylor series (or, more specifically, of Maclaurin series).

On the set of exponents

Negative powers are not permitted in an ordinary power series; for instance, ${\textstyle x^{-1}+1+x^{1}+x^{2}+\cdots }$ is not considered a power series (although it is a Laurent series). Similarly, fractional powers such as ${\textstyle x^{\frac {1}{2}}}$ are not permitted; fractional powers arise in Puiseux series. The coefficients ${\textstyle a_{n}}$ must not depend on ${\textstyle x}$ , thus for instance ${\textstyle \sin(x)x+\sin(2x)x^{2}+\sin(3x)x^{3}+\cdots }$ is not a power series.

Radius of convergence

A power series ${\textstyle \sum _{n=0}^{\infty }a_{n}(x-c)^{n}}$ is convergent for some values of the variable $x$ , which will always include $x = c$ since $(x-c)^{0}=1$ and the sum of the series is thus $a_{0}$ for $x = c$ . The series may diverge for other values of $x$ , possibly all of them. If $c$ is not the only point of convergence, then there is always a number $r$ with $0 < r \leq \infty$ such that the series converges whenever $| x - c | < r$ and diverges whenever $| x - c | > r$ . The number $r$ is called the radius of convergence of the power series; in general it is given as $r=\liminf _{n\to \infty }\left|a_{n}\right|^{-{\frac {1}{n}}}$ or, equivalently, $r^{-1}=\limsup _{n\to \infty }\left|a_{n}\right|^{\frac {1}{n}}.$ This is the Cauchy–Hadamard theorem; see limit superior and limit inferior for an explanation of the notation. The relation $r^{-1}=\lim _{n\to \infty }\left|{a_{n+1} \over a_{n}}\right|$ is also satisfied, if this limit exists.

The set of the complex numbers such that $| x - c | < r$ is called the disc of convergence of the series. The series converges absolutely inside its disc of convergence and it converges uniformly on every compact subset of the disc of convergence.

For $| x - c | = r$ , there is no general statement on the convergence of the series. However, Abel's theorem states that if the series is convergent for some value $z$ such that $| z - c | = r$ , then the sum of the series for $x = z$ is the limit of the sum of the series for $x = c + t (z - c)$ where $t$ is a real variable less than 1 that tends to 1.

Operations on power series

Addition and subtraction

When two functions f and g are decomposed into power series around the same center c, the power series of the sum or difference of the functions can be obtained by termwise addition and subtraction. That is, if $f(x)=\sum _{n=0}^{\infty }a_{n}(x-c)^{n}$ and $g(x)=\sum _{n=0}^{\infty }b_{n}(x-c)^{n}$ then $f(x)\pm g(x)=\sum _{n=0}^{\infty }(a_{n}\pm b_{n})(x-c)^{n}.$

The sum of two power series will have a radius of convergence of at least the smaller of the two radii of convergence of the two series,^[2] but possibly larger than either of the two. For instance it is not true that if two power series ${\textstyle \sum _{n=0}^{\infty }a_{n}x^{n}}$ and ${\textstyle \sum _{n=0}^{\infty }b_{n}x^{n}}$ have the same radius of convergence, then ${\textstyle \sum _{n=0}^{\infty }\left(a_{n}+b_{n}\right)x^{n}}$ also has this radius of convergence: if ${\textstyle a_{n}=(-1)^{n}}$ and ${\textstyle b_{n}=(-1)^{n+1}\left(1-{\frac {1}{3^{n}}}\right)}$ , for instance, then both series have the same radius of convergence of 1, but the series ${\textstyle \sum _{n=0}^{\infty }\left(a_{n}+b_{n}\right)x^{n}=\sum _{n=0}^{\infty }{\frac {(-1)^{n}}{3^{n}}}x^{n}}$ has a radius of convergence of 3.

Multiplication and division

With the same definitions for $f(x)$ and $g(x)$ , the power series of the product and quotient of the functions can be obtained as follows: ${\begin{aligned}f(x)g(x)&={\biggl (}\sum _{n=0}^{\infty }a_{n}(x-c)^{n}{\biggr )}{\biggl (}\sum _{n=0}^{\infty }b_{n}(x-c)^{n}{\biggr )}\\&=\sum _{i=0}^{\infty }\sum _{j=0}^{\infty }a_{i}b_{j}(x-c)^{i+j}\\&=\sum _{n=0}^{\infty }{\biggl (}\sum _{i=0}^{n}a_{i}b_{n-i}{\biggr )}(x-c)^{n}.\end{aligned}}$

The sequence ${\textstyle m_{n}=\sum _{i=0}^{n}a_{i}b_{n-i}}$ is known as the Cauchy product of the sequences $a_{n}$ and $b_{n}$ .

For division, if one defines the sequence $d_{n}$ by ${\frac {f(x)}{g(x)}}={\frac {\sum _{n=0}^{\infty }a_{n}(x-c)^{n}}{\sum _{n=0}^{\infty }b_{n}(x-c)^{n}}}=\sum _{n=0}^{\infty }d_{n}(x-c)^{n}$ then $f(x)={\biggl (}\sum _{n=0}^{\infty }b_{n}(x-c)^{n}{\biggr )}{\biggl (}\sum _{n=0}^{\infty }d_{n}(x-c)^{n}{\biggr )}$ and one can solve recursively for the terms $d_{n}$ by comparing coefficients.

Solving the corresponding equations yields the formulae based on determinants of certain matrices of the coefficients of $f(x)$ and $g(x)$ $d_{0}={\frac {a_{0}}{b_{0}}}$ $d_{n}={\frac {1}{b_{0}^{n+1}}}{\begin{vmatrix}a_{n}&b_{1}&b_{2}&\cdots &b_{n}\\a_{n-1}&b_{0}&b_{1}&\cdots &b_{n-1}\\a_{n-2}&0&b_{0}&\cdots &b_{n-2}\\\vdots &\vdots &\vdots &\ddots &\vdots \\a_{0}&0&0&\cdots &b_{0}\end{vmatrix}}$

Differentiation and integration

Once a function $f(x)$ is given as a power series as above, it is differentiable on the interior of the domain of convergence. It can be differentiated and integrated by treating every term separately since both differentiation and integration are linear transformations of functions: ${\begin{aligned}f'(x)&=\sum _{n=1}^{\infty }a_{n}n(x-c)^{n-1}=\sum _{n=0}^{\infty }a_{n+1}(n+1)(x-c)^{n},\\\int f(x)\,dx&=\sum _{n=0}^{\infty }{\frac {a_{n}(x-c)^{n+1}}{n+1}}+k=\sum _{n=1}^{\infty }{\frac {a_{n-1}(x-c)^{n}}{n}}+k.\end{aligned}}$

Both of these series have the same radius of convergence as the original series.

Analytic functions

A function f defined on some open subset U of R or C is called analytic if it is locally given by a convergent power series. This means that every a ∈ U has an open neighborhood V ⊆ U, such that there exists a power series with center a that converges to f(x) for every x ∈ V.

Every power series with a positive radius of convergence is analytic on the interior of its region of convergence. All holomorphic functions are complex-analytic. Sums and products of analytic functions are analytic, as are quotients as long as the denominator is non-zero.

If a function is analytic, then it is infinitely differentiable, but in the real case the converse is not generally true. For an analytic function, the coefficients a_n can be computed as $a_{n}={\frac {f^{\left(n\right)}\left(c\right)}{n!}}$

where $f^{(n)}(c)$ denotes the nth derivative of f at c, and $f^{(0)}(c)=f(c)$ . This means that every analytic function is locally represented by its Taylor series.

The global form of an analytic function is completely determined by its local behavior in the following sense: if f and g are two analytic functions defined on the same connected open set U, and if there exists an element $c \in U$ such that $f (n) (c) = g (n) (c)$ for all $n \geq 0$ , then $f (x) = g (x)$ for all $x \in U$ .

If a power series with radius of convergence r is given, one can consider analytic continuations of the series, that is, analytic functions f which are defined on larger sets than ${x | | x - c | < r}$ and agree with the given power series on this set. The number r is maximal in the following sense: there always exists a complex number $x$ with $| x - c | = r$ such that no analytic continuation of the series can be defined at $x$ .

The power series expansion of the inverse function of an analytic function can be determined using the Lagrange inversion theorem.

Behavior near the boundary

The sum of a power series with a positive radius of convergence is an analytic function at every point in the interior of the disc of convergence. However, different behavior can occur at points on the boundary of that disc. For example:

Divergence while the sum extends to an analytic function: ${\textstyle \sum _{n=0}^{\infty }z^{n}}$ has radius of convergence equal to $1$ and diverges at every point of $|z|=1$ . Nevertheless, the sum in $|z|<1$ is ${\textstyle {\frac {1}{1-z}}}$ , which is analytic at every point of the plane except for $z=1$ .
Convergent at some points divergent at others: ${\textstyle \sum _{n=1}^{\infty }{\frac {z^{n}}{n}}}$ has radius of convergence $1$ . It converges for $z=-1$ , while it diverges for $z=1$ .
Absolute convergence at every point of the boundary: ${\textstyle \sum _{n=1}^{\infty }{\frac {z^{n}}{n^{2}}}}$ has radius of convergence $1$ , while it converges absolutely, and uniformly, at every point of $|z|=1$ due to Weierstrass M-test applied with the hyper-harmonic convergent series ${\textstyle \sum _{n=1}^{\infty }{\frac {1}{n^{2}}}}$ .
Convergent on the closure of the disc of convergence but not continuous sum: Sierpiński gave an example^[3] of a power series with radius of convergence $1$ , convergent at all points with $|z|=1$ , but the sum is an unbounded function and, in particular, discontinuous. A sufficient condition for one-sided continuity at a boundary point is given by Abel's theorem.

Formal power series

In abstract algebra, one attempts to capture the essence of power series without being restricted to the fields of real and complex numbers, and without the need to talk about convergence. This leads to the concept of formal power series, a concept of great utility in algebraic combinatorics.

Power series in several variables

An extension of the theory is necessary for the purposes of multivariable calculus. A power series is here defined to be an infinite series of the form $f(x_{1},\dots ,x_{n})=\sum _{j_{1},\dots ,j_{n}=0}^{\infty }a_{j_{1},\dots ,j_{n}}\prod _{k=1}^{n}(x_{k}-c_{k})^{j_{k}},$ where $j = (j 1, \dots, j n)$ is a vector of natural numbers, the coefficients $a (j 1, \dots, j n)$ are usually real or complex numbers, and the center $c = (c 1, \dots, c n)$ and argument $x = (x 1, \dots, x n)$ are usually real or complex vectors. The symbol $\Pi$ is the product symbol, denoting multiplication. In the more convenient multi-index notation this can be written $f(x)=\sum _{\alpha \in \mathbb {N} ^{n}}a_{\alpha }(x-c)^{\alpha }.$ where $\mathbb {N}$ is the set of natural numbers, and so $\mathbb {N} ^{n}$ is the set of ordered n-tuples of natural numbers.

The theory of such series is trickier than for single-variable series, with more complicated regions of convergence. For instance, the power series ${\textstyle \sum _{n=0}^{\infty }x_{1}^{n}x_{2}^{n}}$ is absolutely convergent in the set $\{(x_{1},x_{2}):|x_{1}x_{2}|<1\}$ between two hyperbolas. (This is an example of a log-convex set, in the sense that the set of points $(\log |x_{1}|,\log |x_{2}|)$ , where $(x_{1},x_{2})$ lies in the above region, is a convex set. More generally, one can show that when c=0, the interior of the region of absolute convergence is always a log-convex set in this sense.) On the other hand, in the interior of this region of convergence one may differentiate and integrate under the series sign, just as one may with ordinary power series.^[4]

Order of a power series

Let $α$ be a multi-index for a power series $f (x 1, x 2, \dots, x n)$ . The order of the power series f is defined to be the least value $r$ such that there is a_α ≠ 0 with $r=|\alpha |=\alpha _{1}+\alpha _{2}+\cdots +\alpha _{n}$ , or $\infty$ if f ≡ 0. In particular, for a power series f(x) in a single variable x, the order of f is the smallest power of x with a nonzero coefficient. This definition readily extends to Laurent series.