it is important only do to so right as it is done flowering.
should you choose to replace it, then you will be replacing with a much larger tree. it is always best to assume that it can get a little bigger than stated. this will keep you from planting too close.
ultimately, the call is up to you. it can be quite a pain to remove a tree, and keep it from coming back from roots and seedlings, though. 