If a question is flagged to be removed, but it has some reputation associated with it, what happens to that reputation?

If the user has reputation from up votes on the question, will the user loose that reputation?

Does removing questions with down votes return lost reputation to affected users?