Is it necessary to clear site caches after putting site into maintenance mode?
As you stated that 'The actual display of the maintenance page is not really important' hence it is not necessary to clear the site caches in this case. 

But it is best practice to do so, because if any user interactions like forms are there, user will be getting error messages!!