BUG: fix regression with SerieGrouper with Timestamp index (#42390)
closes https://github.com/pandas-dev/pandas/issues/42390

This fixes a regression introduced in c355ed1 where cache is not
initialized with correct state of islider and vslider.

On Timestamp index this trigger a "ValueError Length of values does not match length of index"