Using an alternative name part of the way through my academic career
A difficult question to answer as, ultimately, this is quite personal. It is "what are you willing to put up with" mixed with "how much of your own personal identity do you ascribe to your name"? 

I have a colleague who has had (at least) three different names during their academic publishing career and no one knows how to cite their work: do we convert publications under old names to new names? I also constantly have to tell students and other scholars "that's the same person...". It isn't great. Perhaps if you have a colleague that has changed their name due to marriage or other circumstances, you might discuss with them their experiences of building a profile anew. 

One thing is for certain: if you don't change the name you use, you'll be memorable to the readers of your work. You'll come to mind before Jane Smith and John Jones.