The person will not be notified you've deleted the message But if they're on their Instagram feed and see a DM has come through with the messenger icon going blue with a '1' in it, and then you delete a the message, the blue icon will go back to as if there's no message.