In 1989 the first edition of this book set out Gittins' pioneering index solution to the multi-armed bandit problem and his subsequent investigation of a wide o

In 1989 the first edition of this book set out Gittins' pioneering index solution to the multi-armed bandit problem and his subsequent investigation of a wide o

Multi-armed bandits is a rich, multi-disciplinary area that has been studied since 1933, with a surge of activity in the past 10-15 years. This is the first boo

A comprehensive and rigorous introduction for graduate students and researchers, with applications in sequential decision-making problems.

This book covers control theory signal processing and relevant applications in a unified manner. It introduces the area, takes stock of advances, and describes