class_docstr: Original Implementation of the GELU activation function in Google BERT repo when initially created. For
  information: OpenAI GPT's GELU is slightly different (and gives slightly different results): 0.5 * x * (1 +
  torch.tanh(math.sqrt(2 / math.pi) * (x + 0.044715 * torch.pow(x, 3)))) This is now written in C in nn.functional
  Also see the Gaussian Error Linear Units paper: https://arxiv.org/abs/1606.08415
class_docstr_tok: ["Original","Implementation","of","the","GELU","activation","function","in","Google","BERT","repo","when","initially","created",".","For","information",":","OpenAI","GPT","'s","GELU","is","slightly","different","(","and","gives","slightly","different","results",")",":","0.5","*","x","*","(","1","+","torch.tanh","(","math.sqrt","(","2","\/","math.pi",")","*","(","x","+","0.044715","*","torch.pow","(","x",",","3",")",")",")",")","This","is","now","written","in","C","in","nn.functional","Also","see","the","Gaussian","Error","Linear","Units","paper",":","https",":","\/\/arxiv.org\/abs\/1606.08415"]
code: def __init__(self, use_gelu_python: bool = False):
      super().__init__()
      if use_gelu_python:
          self.act = self._gelu_python
      else:
          self.act = nn.functional.gelu
  
imports: import math
  import warnings
  from collections import OrderedDict
  import torch
  from packaging import version
  from torch import Tensor, nn
  from .utils import logging
label_desc: Use image node_id 1 to create a new GELUActivation object from inherited base classes: nn with example: obj = GELUActivation(use_gelu_python)