daisy had been scared that mrs rogers wouldnt allow her to join them , after catching her in the tropical gardens ; but she guessed that because she was out there with the permission of the young master , there was nothing the housekeeper could do .