본문 바로가기

Reinforcement Learning5

RL Course by David Silver - Lecture 4: Model Free Prediction This article summarizes RL Course by David Silver - Lecture 4: Model Free Prediction. This chapter will mainly discuss how to predict the value of each state. Monte Carlo and Time Difference is a two main streams algorithm. Chapter 3 was about known MDP. Here we deal with an unknown MDP. Model-free prediction updates the value function of unknown MDP, and Model control updates the policy based o.. 2022. 8. 4.
On-Policy, Off-Policy, Online, Offline 강화학습 On-Policy, Off-Policy, Online, Offline 강화학습은 기본 개념에 속하는 단어이지만, 그 개념을 잘 파악하기 이전까지는 계속 헷갈리는 워딩입니다. 이번 글에서는 짤막하게 위 분류에 대해서 확인해보려 합니다. On-Policy/Off-Policy 강화학습 먼저 이해가 비교적 쉬운 On-Policy와 Off-Policy 강화학습부터 살펴보겠습니다. On-Policy와 Off-Policy 알고리즘에 대해서 스터디원이 해준 비유가 있습니다. 여러분이 스타크래프트를 배우려 하는 상황을 가정해봅시다. 스타크래프트를 배울 때는 내가 직접 플레이하면서 이기고 지는 것을 반복하며 배울수도 있습니다. 하지만 이와 반대로 친구가 하는 것을 뒤에서 보면서 '아 지금은 멀티 먹지 말고 타이밍 러쉬 갔.. 2022. 6. 23.
RL Course by David Silver - Lecture 3: Planning by Dynamic Programming This article summarizes RL Course by David Silver - Lecture 3: Planning by Dynamic Programming. This chapter will discuss policy evaluation, policy iteration, and value iteration. Each concept has an important role in reinforcement learning. Introduction Before we start, what is dynamic programming? A dynamic problem has a sequential or temporal component. Programming is optimizing a program(in .. 2022. 5. 18.
RL Course by David Silver - Lecture 2: Markov Decision Processes This article summarizes RL Course by David Silver - Lecture 2: Markov Decision Processes. Markov Property When we assume every data about the past is in the present state, that state has a Markov property. The state transition matrix $P$ contains all information about transition probability between states. Markov Process The sequence of states with Markov property (or Markov chain) is a Markov p.. 2022. 5. 3.
RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning This article summarizes RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning. Reinforcement learning has no supervisor. The reward signal guides the agent if things are going right or wrong. The feedback is delayed. Some feedback takes hours to obtain, such as go game. The data that the agent receives is sequential. So the action of the agent affects the information it r.. 2022. 4. 27.