This tutorial is about learning through exploration. The goal is to learn how to make decisions in partial feedback settings where an agent repeatedly observes some information, chooses an action, and then learns how this action paid off (but doesn't get to see how other actions would have paid off). We plan to cover all aspects of this general problem: learning, evaluation, limitations of ability to learn in this setting, and the relationship to traditional supervised learning.