Standard deviation in batches
I am using this function to compute the standard deviation of my output. I am evaluating my model on 2000 examples, in batches of 4. Can I just take the standard deviation per batch and then divide by 2000 ? 

No, you can't. Have a look at this post where batch updates of the mean and the standard deviation are explained in a nice way, with both math and code.
