rfho/optimizers.py
def d_dynamics_d_hyper_loss(self, grad_loss_term, name):
        """
        Helper function for building the partial derivative of the dynamics w.r.t. an hyperparameter
        inside the loss function, given the gradient or Jacobian of loss w.r.t.

        :param name: name of the resulting MergedMatrix
        :param grad_loss_term: should be \nabla R
        :return: Partial derivative of dynamics w.r.t. weighting hyperparameter (e.g. gamma)
        """
        return ZMergedMatrix(-self.learning_rate * grad_loss_term, name=name)

        Helper function for building the partial derivative of the dynamics w.r.t. an hyperparameter
        inside the loss function, given the gradient or Jacobian of loss w.r.t.

        :param name: name of the resulting MergedMatrix
        :param grad_loss_term: should be \nabla R
        :return: Partial derivative of dynamics w.r.t. weighting hyperparameter (e.g. gamma)
        
Helper function for building the partial derivative of the dynamics w.r.t. an hyperparameter
inside the loss function, given the gradient or Jacobian of loss w.r.t.
Helper function for building the partial derivative of the dynamics w . r . t . an hyperparameter inside the loss function given the gradient or Jacobian of loss w . r . t .
def d_dynamics_d_hyper_loss(self, grad_loss_term, name):
        return ZMergedMatrix(-self.learning_rate * grad_loss_term, name=name)
def d_dynamics_d_hyper_loss ( self , grad_loss_term , name ) : return ZMergedMatrix ( - self . learning_rate * grad_loss_term , name = name )
Helper function for building the partial derivative of the dynamics w.r.t.
Helper function for building the partial derivative of the dynamics w . r . t .
"""
        Helper function for building the partial derivative of the dynamics w.r.t. an hyperparameter
        inside the loss function, given the gradient or Jacobian of loss w.r.t.

        :param name: name of the resulting MergedMatrix
        :param grad_loss_term: should be \nabla R
        :return: Partial derivative of dynamics w.r.t. weighting hyperparameter (e.g. gamma)
        """
Partial derivative of dynamics w.r.t. weighting hyperparameter
Partial derivative of dynamics w . r . t . weighting hyperparameter
self
grad_loss_term
should be \nabla R
should be \ nabla R
name
name of the resulting MergedMatrix
name of the resulting MergedMatrix