How do I theme the user register page?
This is similar in D8. Copy page.html.twig from core or base theme and put it into the template directory of your theme.

Rename it like this:

page--user--register.html.twig