Professor submitted my letter of recommendation after I removed him
Your perception was entirely reasonable, and as somebody who is serious, you can't let unreliable people decide your fate. So, it is very logical, and nobody should blame you because you did the best thing you could. The point is, should you even communicate the substitution to him, and if yes, what good does it do? If you couldn't find any reason for doing so, then perhaps you shouldn't. This whole recommendation letter is entirely about you and given that he didn't even bother to check or post, you can just simply ignore him. A few months later things will be back to normal and people will simply forget about it.