title: Robots.txt disallow path with regular expression
body: <p>Does <code>robots.txt</code> accept regular expression ?
  I have many <code>URL</code>s with this format:</p>
  
  <pre><code>https://example.com/view/99/title-sample-text
  ID ----------------------^
  Title -----------------------------^
  </code></pre>
  
  <p>I used this:</p>
  
  <pre><code>Disallow: /view
  </code></pre>
  
  <p>But look like this not working because <code>google</code> indexed more pages. so i want to do this with regex, something like this:</p>
  
  <pre><code>Disallow: /view/([0-9]+)/([^/]*)
  </code></pre>
  
  <p>But is this correct format or valid in <code>robots.txt</code> ?</p>