pandas "cumulative" rolling_corr
Just use rolling correlation, with a very large window, and min_period = 1.
Is there any built-in pandas' method to find the cumulative correlation between two pandas series? 
What it should do is effectively fixing the left side of the window in pandas.rolling_corr(data, window) so that the width of the window increases and eventually the window includes all data points.