iTunes keeps losing its library
Mavericks has a new external-hard-disk power management system in place which would turn off the hard-disk (only concerns external drives) if it's not used for a certain amount of time. 

I suspect this is what's causing the lag rather than iTunes forgetting the location of the library.