I asked for a recommendation, then decided I wouldn't, but I've changed my mind again. Will the professor feel annoyed?
Probably yes. 

Writing a strong letter of recommendation demands some effort. Make sure of your decision before asking for your professor to invest his time in it.