class_docstr: Taken from the official evaluation script for v1.1 of the SQuAD dataset
class_docstr_tok: ["Taken","from","the","official","evaluation","script","for","v1.1","of","the","SQuAD","dataset"]
docstr: Lower text and remove punctuation, articles and extra whitespace.
docstr_tok: ["Lower","text","and","remove","punctuation",",","articles","and","extra","whitespace","."]
code: def normalize(self, s):
      """Lower text and remove punctuation, articles and extra whitespace."""
  
      def remove_articles(text):
          return re.sub(r"\b(a|an|the)\b", " ", text)
  
      def white_space_fix(text):
          return " ".join(text.split())
  
      def remove_punc(text):
          exclude = set(string.punctuation)
          return "".join(ch for ch in text if ch not in exclude)
  
      def lower(text):
          return text.lower()
  
      return white_space_fix(remove_articles(remove_punc(lower(s))))
  
imports: import logging
  import re
  import string
  from collections import Counter
  from typing import List, Union
  import torch
  from torchmetrics import Metric
label_desc: Use image node_id 5 for calling the TokenF1Score obj's underlying member method code with example usage: obj.normalize(s) and returns: white_space_fix, re, str, str, text