title: Scraping TikTok
body: <p>scraping, and i am trying to use Scrapy for extracting data from a 'tiktok-sound' page: </p>
  
  <pre><code>https://www.tiktok.com/music/suono-originale-6779112295713835782?language=it&amp;u_code=d90m008db854c7&amp;utm_campaign=client_share&amp;app=musically&amp;utm_medium=ios&amp;user_id=6750615737545131014&amp;tt_from=copy&amp;utm_source=copy&amp;source=h5_m
  </code></pre>
  
  <p>This is my spider :</p>
  
  <pre><code>   import scrapy
  
  
  class MySpider(scrapy.Spider):
      name = "tiktok"
      start_urls = [
          "https://www.tiktok.com/music/suono-originale-6779112295713835782?language=it&amp;u_code=d90m008db854c7&amp;utm_campaign=client_share&amp;app=musically&amp;utm_medium=ios&amp;user_id=6750615737545131014&amp;tt_from=copy&amp;utm_source=copy&amp;source=h5_m",
      ]
  
      def parse(self, response):
          redirect_url_list = response.meta.get('redirect_urls')
  
          if ".com" in response.url :
              from scrapy.shell import inspect_response
              inspect_response(response, self)
  
  </code></pre>
  
  <p>my hope is that somehow I could extract data from the follow HTML tag :</p>
  
  <pre><code>&lt;h2 class="share-desc"&gt;239&lt;!-- --&gt; &lt;!-- --&gt;videos&lt;/h2&gt;
  </code></pre>
  
  <p>But unluckly when i do <code>view(response)</code> I don't get the same html I am getting from <code>Inspect Window</code> on Chrome Developer Tools.</p>
  
  <p>Instead it is somehow redirecting me somewhere else and i can't extract anything :</p>
  
  <p>This is the log i think is most important for you: </p>
  
  <pre><code>2020-02-12 12:43:35 [scrapy.middleware] INFO: Enabled item pipelines:
  []
  2020-02-12 12:43:35 [scrapy.core.engine] INFO: Spider opened
  2020-02-12 12:43:35 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
  2020-02-12 12:43:35 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
  2020-02-12 12:43:35 [scrapy.core.engine] DEBUG: Crawled (200) &lt;GET https://www.tiktok.com/robots.txt&gt; (referer: None)
  2020-02-12 12:43:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to &lt;GET https://m.tiktok.com/v/0.html&gt; from &lt;GET https://www.tiktok.com/music/suono-originale-6779112295713835782?language=it&amp;u_code=d90m008db854c7&amp;utm_campaign=client_share&amp;app=musically&amp;utm_medium=ios&amp;user_id=6750615737545131014&amp;tt_from=copy&amp;utm_source=copy&amp;source=h5_m&gt;
  2020-02-12 12:43:36 [scrapy.core.engine] DEBUG: Crawled (200) &lt;GET https://m.tiktok.com/robots.txt&gt; (referer: None)
  2020-02-12 12:43:36 [scrapy.core.engine] DEBUG: Crawled (200) &lt;GET https://m.tiktok.com/v/0.html&gt; (referer: None)
  &lt;200 https://m.tiktok.com/v/0.html&gt;
  </code></pre>
  
  <p>If you could explain what is happening here,  cause I have no idea</p>
  
  <p>Thank You</p>