How can I get rid of a stuck folder in the Finder's toolbar?
Well I don't know if this is what you mean, but I accidentally dragged a folder into the Finder, and when I removed it a question mark appeared. 

How to delete an accidentally-dragged-in folder in the Finder toolbar:

Just hold Command ⌘ and drag the folder out of the Finder window and whoosh it's gone.