Custom formatting of tokens for date fields
The Token module added direct support for datetime and daterange fields in December 2016. See https://www.drupal.org/project/token/issues/2786181. 

You should be able to use something like [node:field_datetime:date:custom:Y]