Theorem 3.3.1 is a statement of Taylor's theorem, expressing a sufficiently smooth function as the sum of a polynomial and a remainder term.
Functions for which the remainder term goes to zero for all in some interval about the expansion point are essentially given by an "infinite polynomial" or, in terms of Chapter 8, by an infinite series. Thus, a function with an appropriately behaved remainder has a power series representation, and this series is called a Taylor series.
When the expansion point is , the power series representation of is sometimes called a Maclaurin series, but some authors will simplify the terminology and use just the term "Taylor series" for all convergent power-series.
Thus, if a power series converges to , then that series is the Taylor series of . But given an arbitrary function , even one for which all derivatives exist, the expansion (called the formal Taylor expansion)
which is formed by the "Taylor series recipe" may not converge to . (See Example 8.5.1.)
Once again, a convergent power series is the Taylor series for the limit function, but the formal Taylor expansion of may not be the power-series representation of . because may not have a power-series representation.
Section 8.5 deals with functions that indeed have a Taylor series representation. Determining which functions actually have a power-series (and hence a Taylor series) representation is no small matter. The most satisfying answers to this question are given for functions of a complex variable, that is, for functions , where . For such functions, if one derivative exists in a neighborhood, all derivatives exist and the Taylor expansion actually represents the function. But for functions of the real variable , the situation is not so sanguine. Real functions can have just a finite number of derivatives and no more. Moreover, even functions with all derivatives may not have a Taylor series that converges back to the function, as is the case with the example function in Example 8.5.1.
If it can be shown that the Taylor-expansion remainder
(not just from Theorem 3.3.1) goes to zero as , then the formal Taylor series of does indeed converge to, i.e., represent, . But it is no easy matter to show this for an arbitrary function, essentially because of the need to have either a representation of or an estimate of how these derivatives behave as . In the examples below, this is done for a few of the elementary functions, but in general, determining whether or not a function has a Taylor series representation relies heavily on the theory of complex variables.