How to properly use approximate_predict() with HDBSCAN clusterer for text clustering (NLP)?
Why do you recompute the distance matrix?

Just compute the 1x5000 vector directly for all new points. You can even do this in batches, then feed one row at a time to the predictor.