Tips on speeding up hierarchical linkage clustering algorithm
Yes.  After you merge two points, you can update the distances of just the affected nodes, without having to recompute all pairs of distances again.  That will be vastly faster.