How to add Google recaptcha to a custom form?
You can use recaptcha module (https://www.drupal.org/project/recaptcha)
and in captcha settings(admin/config/people/captcha) you can add your custom form's form_id and select the challenge type reCAPTCHA(from module recaptcha). This should work.