API: Inconsistent handling of columns aggregated to create date columns
Issue is described at https://github.com/pandas-dev/pandas/pull/23832#pullrequestreview-177106215

Should we parse columns that are used to construct date columns or not?