class_docstr: SwiGLU
  NOTE: GluMLP above can implement SwiGLU, but this impl has split fc1 and
  better matches some other common impl which makes mapping checkpoints simpler.
code: def init_weights(self):
      # override init of fc1 w/ gate portion set to weight near zero, bias=1
      nn.init.ones_(self.fc1_g.bias)
      nn.init.normal_(self.fc1_g.weight, std=1e-6)
  
imports: from functools import partial
  from torch import nn
  from .grn import GlobalResponseNorm
  from .helpers import to_2tuple
label_desc: Use image node_id 2 for calling the SwiGLU obj's underlying member method code with example usage: obj.init_weights() without return types