The theory of Markov decision processes focuses on controlled Markov chains in discrete time. The authors establish the theory for general state and action spaces and at the same time show its application by means of numerous examples, mostly taken from the fields of finance and operations research. By using a structural approach many technicalities (concerning measure theory) are avoided. They cover problems with finite and infinite horizons, as well as partially observable Markov decision processes, piecewise deterministic Markov decision processes and stopping problems.

The book presents Markov decision processes in action and includes various state-of-the-art applications with a particular view towards finance. It is useful for upper-level undergraduates, Master's students and researchers in both applied probability and finance, and provides exercises (without solutions). "

This book explores discrete-time dynamic optimization and provides a detailed introduction to both deterministic and stochastic models. Covering problems with finite and infinite horizon, as well as Markov renewal programs, Bayesian control models and partially observable processes, the book focuses on the precise modelling of applications in a variety of areas, including operations research, computer science, mathematics, statistics, engineering, economics and finance. Dynamic Optimization is a carefully presented textbook which starts with discrete-time deterministic dynamic optimization problems, providing readers with the tools for sequential decision-making, before proceeding to the more complicated stochastic models. The authors present complete and simple proofs and illustrate the main results with numerous examples and exercises (without solutions). With relevant material covered in four appendices, this book is completely self-contained.

Dieses Lehrbuch bietet eine leicht verstandliche Einfuhrung in die moderne Finanzmathematik und erlautert grundlegende mathematische Konzepte der Optionsbewertung, der Portfolio-Optimierung und des Risikomanagements. Hierzu gehoeren die Preisbestimmung durch Arbitrageuberlegungen, die Preisbestimmung von amerikanischen Optionen uber die Loesung optimaler Stopp-Probleme, die Bestimmung von optimalen Konsum- und Investitionsstrategien und Erwartungswert-Varianz Portfolios. Aktuelle Konzepte der Risikomessung wie Value at Risk und Expected Shortfall werden ebenso vorgestellt.Grundlagen in Stochastik und Optimierung reichen fur das Verstandnis der Inhalte aus und zahlreiche UEbungsaufgaben mit ausfuhrlichen Loesungen sowie drei Anhange erleichtern das Selbststudium.