Comparing rates of return for different assets using $V=Pe^{rT}$
First of all stop using discrete interest in your intermediate steps to keep your work simple. (As a final step you can convert continuous to discrete if you want to.)
The reason you get different results when you change the start and end dates is because the longer the time period the more the result (growth rate of the totals) will approach the biggest growth rate. By implication the dates do not matter; only the length of the period, so 1901 to 1911 gives you the same result as 2001 to 2011. I didn't test this but it seems like it would be true.
You said you want the overall growth rate.
You can take the average (the mean).
You can take the trimmed mean, which is the average after discarding the highest and lowest rate because may be they are anomalies. Since you don't have a lot of data, you might not want to do the trimmed mean.
You can take the price weighted mean of all data or the trimmed data. I would use initial prices, to be specific. Since you might want to buy the whole street (big spender) the price weighted mean might be more relevant to you. If you're only interested in buying one randomly selected house, the mean or trimmed mean is better.
You can take the median if you think higher and lower rates are less useful for your purpose but you would probably want more than 4 houses in your set if you take a median. If you're only interested in buying one house and you have a median-sized budget then the median rate is more interesting for you.