It was Melbourne 's first harbor and port for the Port Phillip district until the late 19th century . It served as Melbourne 's first anchorage and as the center for port facilities to the Port Phillip district until the late 19th century .