I have a intuitive question on the convergence of $Q$- learning. In $Q$ learning for each step a $Q$- value is learned for the state-action pair where the action is selected according to the ...
I have a Q-learning algorithm with a finite number of states. Each state, however is represented by the usual 32bit Q-value. These Q-values allow to carry information about the previous experience far ...