Windows appear in odd places in Yosemite
Might be worth trying to login as another user, either creating a new user, or using the guest account to see if it happens there also, if it does not. It would suggest the issue is with the preferences in your user account, especially if it only happens in some apps, you can look to clear their caches and preferences. However if it continues, I would suggest backup and reinstall the operating system.