title: Can't block AspiegelBot in htaccess or robots.txt
body: <p>I have issues with AspiegelBot crawling one of the sites on a server, this results in a lot of cores getting used up. I've been trying to block the bot in both in the sites htaccess with no sucess. The bot still constantly appears in my access.log</p>
  
  <pre><code>114.119.165.232 - - [20/Apr/2020:07:38:40 +0200] "GET /tillbehor.html?size=98%2C422%2C423%2C1129%2C1378 HTTP/1.1" 301 296 "-" "Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; AspiegelBot)"
  </code></pre>
  
  <p>Here is some of what I've tried:</p>
  
  <p><strong>htaccess</strong></p>
  
  <pre><code>Options +FollowSymLinks
  RewriteEngine on
  RewriteCond %{HTTP_USER_AGENT} ^.(Mb2345Browser|AspiegelBot|LieBaoFast|MicroMessenger|zh-CN|Kinza|Mb2345Browser).$ [NC]
  RewriteRule .* - [F,L]
  </code></pre>
  
  <p><strong>robots.txt</strong></p>
  
  <pre><code>User-agent: *
  Allow: /
  Disallow: */shopby
  
  #######################################
  ################ PAGES ################
  #######################################
  
  Disallow: /privacy-policy-cookie-restriction-mode/
  Disallow: /terms/
  
  #######################################
  ############# Block Bots ##############
  #######################################
  
   User-agent: MJ12bot
   Disallow: /
   User-agent: SemrushBot
   Disallow: /
   User-agent: SemrushBot-SA
   Disallow: /
   User-agent: rogerbot
   Disallow:/
   User-agent: dotbot
   Disallow:/
   User-agent: AhrefsBot
   Disallow: /
   User-agent: Alexibot
   Disallow: /
   User-agent: SurveyBot
   Disallow: /
   User-agent: Xenu's
   Disallow: /
   User-agent: Xenu's Link Sleuth 1.1c
   Disallow: /
   User-agent: AspiegelBot
   Disallow: /
  </code></pre>
  
  <p>Am I missing something or writing something incorrectly? Ï'm kinda at a loss here.</p>