re-tape when replacing drywall sheet
Use your drywall knife to scrape out anything loose. If you're familiar with drywall finishing you just treat it like a normal new butt joint and feather the repair to make it appear flat. Usually 12-18 inches onto the finished surface is enough to hide the repair.