title: Disallow Robots in API URL using PHP
body: <p>I know I can disallow robots using robots.txt but few search engines does not follow this. Hence I have a API where my users sends transactional info to insert/update/delete etc., using my API Request Parameters. But when I look at my logs, huge hits have been made to my .php page, Hence I google to use it in my php API page and found nothing.</p>
  
  <p>Hence I landed on SO to get help from experts, is there any way I can block/disallow SE robots to access my base API URL?</p>