Applied Stochastic Processes introduces the reader to stochastic processes with a focus on the applications of the theoretical results. This text is self-contained and logically organized. It begins with a review of elementary probability, followed by an introduction to the most important subjects in the field of stochastic processes. Topics covered include Gaussian and Markovian processes, Markov Chains, Weiner and Poisson processes, Brownian motion, and queuing theory with a special highlight on diffusion processes. The reader will appreciate the clear definitions, thoroughly explained examples and interesting notes about the mathematicians referenced throughout the text. In addition, there are hundreds of advanced, multi-part problems following each chapter which enable even a novice of theoretical mathematics to master the material presented. This textbook evolved from the author's lecture notes for a graduate-level course on applied stochastic processes. It is meant for graduate-level students in electrical engineering, applied mathematics, and notably operations research.

This book moves systematically through the topic of applied probability from an introductory chapter to such topics as random variables and vectors, stochastic processes, estimation, testing and regression. The topics are well chosen and the presentation is enriched by many examples from real life. Each chapter concludes with many original, solved and unsolved problems and hundreds of multiple choice questions, enabling those unfamiliar with the topics to master them. Additionally appealing are historical notes on the mathematicians mentioned throughout, and a useful bibliography. A distinguishing character of the book is its thorough and succinct handling of the varied topics.

The main intended audience for this book is undergraduate students in pure and applied sciences, especially those in engineering. Chapters 2 to 4 cover the probability theory they generally need in their training. Although the treatment of the subject is surely su?cient for non-mathematicians, I intentionally avoided getting too much into detail. For instance, topics such as mixed type random variables and the Dirac delta function are only brie?y mentioned. Courses on probability theory are often considered di?cult. However, after having taught this subject for many years, I have come to the conclusion that one of the biggest problems that the students face when they try to learn probability theory, particularly nowadays, is their de?ciencies in basic di?erential and integral calculus. Integration by parts, for example, is often already forgotten by the students when they take a course on probability. For this reason, I have decided to write a chapter reviewing the basic elements of di?erential calculus. Even though this chapter might not be covered in class, the students can refer to it when needed. In this chapter, an e?ort was made to give the readers a good idea of the use in probability theory of the concepts they should already know. Chapter 2 presents the main results of what is known as elementary probability, including Bayes' rule and elements of combinatorial analysis.

This book moves systematically through the topic of applied probability from an introductory chapter to such topics as random variables and vectors, stochastic processes, estimation, testing and regression. The topics are well chosen and the presentation is enriched by many examples from real life. Each chapter concludes with many original, solved and unsolved problems and hundreds of multiple choice questions, enabling those unfamiliar with the topics to master them. Additionally appealing are historical notes on the mathematicians mentioned throughout, and a useful bibliography. A distinguishing character of the book is its thorough and succinct handling of the varied topics.