docstr: Initialize the RMSNorm normalization layer.
  
  Args:
      dim (int): The dimension of the input tensor.
      eps (float, optional): A small value added to the denominator for numerical stability. Default is 1e-6.
  
  Attributes:
      eps (float): A small value added to the denominator for numerical stability.
      weight (nn.Parameter): Learnable scaling parameter.
code: def __init__(self, dim: int, eps: float = 1e-6):
      """
      Initialize the RMSNorm normalization layer.
  
      Args:
          dim (int): The dimension of the input tensor.
          eps (float, optional): A small value added to the denominator for numerical stability. Default is 1e-6.
  
      Attributes:
          eps (float): A small value added to the denominator for numerical stability.
          weight (nn.Parameter): Learnable scaling parameter.
  
      """
      super().__init__()
      self.eps = eps
      self.weight = nn.Parameter(torch.ones(dim))
  
file_path: mixtral-kit/mixtralkit/layers/norm.py
imports: import torch
  from typing import Optional, Tuple
  from torch import nn
  import torch.nn.functional
label_desc: Use image node_id 1 to create a new RMSNorm object from inherited base classes: torch.nn with example: obj = RMSNorm(dim, eps)