 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| • |
One
extreme: Always choose action that looks best so far.
|
|
|
– |
What
can potentially happen?
|
|
|
|
– |
Early
bias towards positive reward experience
|
|
|
|
– |
Bias
against exploration for even better reward
|
|
|
| • |
Another
extreme: Always choose actions randomly with
|
|
|
equal
probability
|
|
|
|
– |
Ignores
what it has learned à behavior remains random
|
|
|
| • |
Want
behavior between greedy and random extremes
|
|
|
| • |
Simulated
annealing ideas applicable here: Start with
|
|
|
random
behavior to gather information, gradually become
|
|
|
greedy
to improve performance.
|
|
