title: How to scrape the tweets' external links content for text analytics?
body: <p>I am using following code to scrape the news associated with tweets external links.</p>
  <pre><code>import snscrape.modules.twitter as sntwitter
  import pandas as pd
  import urllib
  import re
  import requests
  
  # Creating list to append tweet data to a dataframe
  tweets_list = []
  
  # Using TwitterSearchScraper to scrape data and append tweets to list
  for i,tweet in enumerate(sntwitter.TwitterSearchScraper('@SkySportsNews OR @cnnsport since:2022-07-06').get_items()):
      url = re.findall(&quot;http[s]?://(?:[a-zA-Z]|[0-9]|[$-_@.&amp;+]|[!*\(\),]|(?:%[0-9a-fA-F][0-9a-fA-F]))+&quot;, tweet.content)
      if len(url) != 0:
          page = requests.get(url)
          if i&gt;18000:
              break
          tweets_list.append([tweet.date, tweet.id, tweet.content, tweet.user.username,url,page.text])
  # Creating a dataframe from the tweets list above
  tweets_df = pd.DataFrame(tweets_list, columns=['Datetime', 'Tweet Id', 'Text', 'Username','url','text'])
  </code></pre>
  <p>But I am getting below error</p>
  <pre><code>&gt; `InvalidSchema: No connection adapters were found for &quot;['http link']&quot;`
  </code></pre>
  <p>and its coming from  page = requests.get(url)` line</p>