The goal of learning theory is to approximate a function from sample values. This is a general overview of the theoretical foundations, and is the first book to emphasize the approximation theory viewpoint. This emphasis provides a balanced approach, and will attract mathematicians to the problems raised.