This book presents recent research in decision making under uncertainty, in particular reinforcement learning and learning with expert advice. The core elements of decision theory, Markov decision processes and reinforcement learning have not been previously collected in a concise volume. Our aim with this book was to provide a solid theoretical foundation with elementary proofs of the most important theorems in the field, all collected in one place, and not typically found in introductory textbooks. This book is addressed to graduate students that are interested in statistical decision making under uncertainty and the foundations of reinforcement learning.

This book constitutes the refereed proceedings of the 27th International Conference on Algorithmic Learning Theory, ALT 2016, held in Bari, Italy, in October 2016, co-located with the 19th International Conference on Discovery Science, DS 2016. The 24 regular papers presented in this volume were carefully reviewed and selected from 45 submissions. In addition the book contains 5 abstracts of invited talks. The papers are organized in topical sections named: error bounds, sample compression schemes; statistical learning, theory, evolvability; exact and interactive learning; complexity of teaching models; inductive inference; online learning; bandits and reinforcement learning; and clustering.