Find the closest point in a point cloud in a near equivalent point cloud
This problem is known as Euclidean minimum cost perfect matching, I have linked a survey by Sayan Bhattacharya that contains various references to algorithms, both exact and approximations.
If you wish to solve this problem for $n \approx 50000$, I would skip the exact solutions entirely and go straight to the approximations.