Insulation in the basement underneath of my fireplace
These areas have always been notorious for being under insulated.  Filling the areas with fiberglass should be fine.  We spray foam the entire area under fireplace bump outs.  This keeps the drafts and cold weather out.