Who do I ask for a letter of recommendation if my advisor and I do not get along?
[deleted my first response as I entirely missed the point of your question]

I think other professors with whom you have worked are the right place to go.  As for hurting the feelings of your previous professor, based on your story of the delayed last letter, I would read that to be that he is unhelpful and wants to put distance between you two.  I doubt very much that he will ever know if you have another professor write you a letter, let alone feel bad about you asking another professor and not him.