Windsor Station was originally called "Chapel Street Station", and was the terminus for northbound trains from the Brighton Beach line.
A possible reason for the construction of the loop line connecting through to St Kilda was the difficulty experienced by contractors in constructing a rail crossing over the Yarra River at Cremorne, known in the early 19th century as "Forrest Hill".