The Discounted sum of future rewards usingdiscount factor  is (reward in 1 time step) + ^ 2 (reward in 2 time steps) + ^ 3 (reward in 3 time steps) + ...I am confused as what constitutes a time-step. Say I take a action now, so I will get a reward in 1 time-step. Then, I will take an action again in timestep 2 to get a second reward in time-step 3But the equation says something else. How does one define a time-step? Can we take action as well receive a reward in a single step? Examples are most helpful.
Definition of time-step in a MDP
reinforcement learning;markov chain