You can delete an ad from an ad set at any time. If you are just changing a video, it might be easier to edit the ad settings.
Scroll down to the ad that you want to delete and click its Delete this Ad button.
Repeat the previous step for each ad to delete.