Water under shower floor caulk
Water will definitely seep into area where the grout is missing and deteriorate the drywall behind the tiles. You need to fix that pronto and check the whole shower for missing or loose grout. Are there any tiles bulging? Hopefully there is no wall damage. Try bleach on the mildew.