Is there any way to REMOVE alert default from All day events?
Go to Calendar preferences and select alerts. Select None on All Day Events like in the image below. You have to do it for every Account defined (iCloud in the example image, but can be Gmail, On my Mac, Whatever...).