title: How to tokenize a 'Python Pandas' 'Series' of strings
body: <p>hello I am trying to convert into tokens of every content of "Chat" which is a column in my pandas dataframe having a length of 1000    </p>
  
  <pre><code>text=df["Chat"]
  words=text.split()
  tokens=word_tokenize(text)
  tokens=[i.lower() for i in words]
  table=str.maketrans("","",string.punctuation)
  stripped=[i.translate(table) for i in tokens]
  words=[words for words in stripped if words.isalpha()]
  stop_words = set(stopwords.words('english'))
  words=[w for w in words if not w in stop_words]
  print(words)
  </code></pre>
  
  <p>following error msg shoes -
  "AttributeError: 'Series' object has no attribute 'split' . </p>
  
  <p>but when I uses iloc to slice it works fine.</p>
  
  <pre><code>text=df["Chat"].iloc[0]
  words=text.split()
  tokens=word_tokenize(text)
  tokens=[i.lower() for i in words]
  table=str.maketrans("","",string.punctuation)
  stripped=[i.translate(table) for i in tokens]
  words=[words for words in stripped if words.isalpha()]
  stop_words = set(stopwords.words('english'))
  words=[w for w in words if not w in stop_words]
  print(words)
  </code></pre>
  
  <p>it works perfectly fine and the output is what i want i.e. a list of tokens.
  i want to convert every item of chat in tokens.</p>