week10_planning

Assignments

Just as usual, start with seminar_MCTS.ipynb

Materials: planning

• Planning by dynamic programming (D. Silver) - video
• Planning via tree search videos 2-6 from CS188
• Our lecture:
  • Lecture(planning, MCTS, planning in POMDP) & Seminar(MCTS)
  • Slides part1 (intro), part2 (pomdp)
• Monte-carlo tree search
  • Monte-carlo tree search step-by-step by J.Levine (very intuitive) - video
  • Udacity video on monte-carlo tree search (first part of a chain) - video
  • A Survey of Monte Carlo Tree Search Methods (2011-2012) pdf
  • Reminder: UCB-1 - slides
  • Guide to MCTS - url or cached

Supplementary materials

• Integrating learning and planning (D. Silver) - video
• Approximating the MCTS optimal actions - 5vision solution for deephack.RL, code by Mikhail Pavlov - repo
• Alpha Go - explanation
• Monte Carlo Planning in POMDP pdf