How can I install Jenkins on Azure?
If I understand your question correctly then yes, you can create a windows VM in azure and install jenkins on it the same way as on a local machine. 

They're might be some differences in the configuration of the environment for example about security, user access, routing etc