Alfred toggles very slowly
I'd recommend turning off fade-in animation under Appearance where you'll see "Fade in Alfred window".

The only reasons Alfred would be slow are either RAM swapping and you're out of memory or, unlikely but possible, could be due to a network drive that is still being looked for after being disconnected.