class_docstr: Implementation of various activation function.
code: def __init__(self, hidden_act):
      super().__init__()
      if hidden_act.lower() == "leakyrelu":
          self.f = nn.functional.leaky_relu
      else:
          self.f = get_activation(hidden_act.lower())
  
imports: import math
  import torch
  from torch import nn
  from transformers.activations import get_activation
  from ..configuration import AdapterFusionConfig, BnConfig
  from ..context import ForwardContext
label_desc: Use image node_id 1 to create a new Activation_Function_Class object from inherited base classes: nn with example: obj = Activation_Function_Class(hidden_act)