@dturquha_no: "In Assignment 3, Part 2 says
"Use a learning rate alpha = 1/N(s,a) where N(s,a) is the number of times 
that an action a was executed in state s."
This gives devide-by-zero errors until we have visited each state at least 
once, and I don't think that setting a = INF is going to be helpful.
Should we use
alpha = 1/(N(s,a) +1) "
    @dlyeung: "<quote>
Just to add to what Pascal said, if you look at the algorithm in
Figure 21.8, you never use alpha = 1/N(s,a) until it's been
incremented at least once.  So if you follow the algorithm
exactly, you can safely initialize N(s,a) to 0 for all s and a
at the beginning.  In fact, you should do this.
If you're getting divide-by-zero errors that might be a sign that
you're doing something wrong.
David L. Yeung
School of Computer Science
University of Waterloo"
{'source': 'USENET', 'other_information': '{"reply_count": 1, "forum_name": "uw.cs.cs486.20150321.mbox"}', 'file': 'data/output/usenet-uw.cs.parquet'}