Minimum size for positive samples for HOG (Histogram of Gradient) detector training
You should use elements which are a power of 2, for easy and faster computation.
I'll say, start with 8x8, so you can only scale up.
And if you have to look only at some portions of this image, then you can crop the original one.