Is my advisor right, am I a turn-off?
It sounds like your advisor is right, and your situation is a turn-off.  He wants you to succeed to improve his own track record, as he is at least by reputation partially responsible for your success or failure.  And other potential advisors don't have that motivation. 

Since you're both in this together, and since you have so much to lose relative to him, I think you need to come to a plan together, and you need to listen to him very carefully and be as cooperative as you can muster yourself to be. He wants you to complete. He wouldn't have had that blunt conversation if he just wanted you to flounder. You need to now cast the past into the past and move forward with whatever you choose to do.