COMPSCI 188 - 2018-09-18 - Markov Decision Processes (MDPs) Part 1/2

COMPSCI 188, LEC 001 - Fall 2018 COMPSCI 188, LEC 001 - Pieter Abbeel, Daniel Klein Copyright @2018 UC Regents; all rights reserved "Slides (from 2018): https://inst.eecs.berkeley.edu/~cs188/fa18 Latest website: https://inst.eecs.berkeley.edu/~cs188 More resources: http://ai.berkeley.edu 00:00 Setup [no content] 03:33 Grid World 11:03 MDP Definition 16:19 Policies 23:16 Optimal Policies 28:08 Example: Racing 32:52 MDP Search Trees 35:02 Utilities of Sequences, Discounting 43:59 Discounting Q&A, Quiz 49:06 Infinite Utilities? 52:44 Break [no content] 54:30 Optimal Values 1:00:20 Equations for Optimal Values 1:05:39 Why Not Expectimax? 1:07:48 Time-Limited Values 1:13:49 Value Iteration 1:19:13 Value Iteration Example 1:23:37 End [no content]"