should I fight to choose journal my work is submitted to?
If the journal is junk, you should not publish there, period. So, the real question is: Is the journal as bad as you think it is or this journal is just not one of the top journals in your area but still a legit, reputable journal? So, confirm which of the two applies. How to distinguish journals has already been discussed several times in this forum. Check the editors, look their homepages if they mention their editorial work there, see who else publishes there and check some of the published articles.

In case this is actually a legit, reputable journal but still not top of the line, you should really consider if your work is actually as good as you think it is. It already has got a rejection and perhaps your advisor suggests some medium (and not top) journal, since he may believe your work might actually have a chance there. So, be open about this and ask him. What does he actually think about your specific work? Is it not good enough for the top journals? If he believes it is not, perhaps you should reconsider your stance.