paddlenlp/transformers/albert/modeling.py
def gelu_new(x):
    """
    Implementation of the GELU activation function currently in Google BERT repo (identical to OpenAI GPT). Also see
    the Gaussian Error Linear Units paper: https://arxiv.org/abs/1606.08415
    """
    return 0.5 * x * (1.0 + paddle.tanh(
        math.sqrt(2.0 / math.pi) * (x + 0.044715 * paddle.pow(x, 3.0))))

    Implementation of the GELU activation function currently in Google BERT repo (identical to OpenAI GPT). Also see
    the Gaussian Error Linear Units paper: https://arxiv.org/abs/1606.08415
    
Implementation of the GELU activation function currently in Google BERT repo (identical to OpenAI GPT).
Implementation of the GELU activation function currently in Google BERT repo ( identical to OpenAI GPT ) .
def gelu_new(x):
    return 0.5 * x * (1.0 + paddle.tanh(
        math.sqrt(2.0 / math.pi) * (x + 0.044715 * paddle.pow(x, 3.0))))
def gelu_new ( x ) : return 0.5 * x * ( 1.0 + paddle . tanh ( math . sqrt ( 2.0 / math . pi ) * ( x + 0.044715 * paddle . pow ( x , 3.0 ) ) ) )
Implementation of the GELU activation function currently in Google BERT repo (identical to OpenAI GPT).
Implementation of the GELU activation function currently in Google BERT repo ( identical to OpenAI GPT ) .
"""
    Implementation of the GELU activation function currently in Google BERT repo (identical to OpenAI GPT). Also see
    the Gaussian Error Linear Units paper: https://arxiv.org/abs/1606.08415
    """
x