With FileVault: Yosemite starts with default desktop background
Ok, it just occurred to me that the answer is obvious: OS X cannot access my Wallpapers folder which is on the second drive, before I have entered the password for using the drive, which obviously happens after the desktop is rendered. Solution: Move the wallpaper to the boot drive.