The person gets a notification when you like or comment on a post. So the person is informed about your activity. However, if you delete the comment, he/she won't be informed. When they check Likes and comments on a post, the person is going to realize that you have deleted the comment.