Model Uncertainty in Sequential Decision Making

author: David Parker, Oxford University
author: Nick Hawes, University of Oxford
author: Bruno Lacerda, University of Oxford
published: Sept. 1, 2023,   recorded: August 2023,   views: 0

Related content

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Lecture popularity: You need to login to cast your vote.
  Delicious Bibliography

 Watch videos:   (click on thumbnail to launch)

Watch Part 1
Part 1 1:27:33
!NOW PLAYING
Watch Part 2
Part 2 1:27:52
!NOW PLAYING
Watch Part 3
Part 3 1:26:47
!NOW PLAYING
Watch Part 4
Part 4 1:02:40
!NOW PLAYING
Watch Part 5
Part 5 1:28:18
!NOW PLAYING

Description

The deployment of autonomous systems in the real world presents opportunities to combine model-based reasoning with data-driven models. To approach this in a systematic way, one must acknowledge the inherent inaccuracies and underspecification of data-driven models. Therefore, understanding and reasoning about model uncertainty is crucial. This reasoning can be qualitative, in the form of policies which are robust to variations in the model, or quantitative, in the form of policies that operate on the belief space of models. This introductory course will focus on understanding and reasoning about model uncertainty. We will introduce several extensions of the standard Markov decision process (MDP) framework for planning under uncertainty that enable reasoning over model uncertainty. We will begin by providing the basics of planning for MDPs, and then use the context of long-term autonomy to demonstrate the need for reasoning about model uncertainty. We will then cover three extensions of MDPs designed to do so: interval MDPs, uncertain MDPs, and Bayes-adaptive MDPs.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment:

make sure you have javascript enabled or clear this field: