rfho/hyper_gradients.py
def std_collect_hyper_gradients(row_gradients):
        """
        Sums over all the step-wise hyper-gradients.

        :param row_gradients: Result of method `backward`
        :return: Hyper-gradients of validation error w.r.t. "fixed" hyperparameters
        """
        return {hyp: sum([r for r in res[1:]], res[0]) for hyp, res in row_gradients.items()}

        Sums over all the step-wise hyper-gradients.

        :param row_gradients: Result of method `backward`
        :return: Hyper-gradients of validation error w.r.t. "fixed" hyperparameters
        
Sums over all the step-wise hyper-gradients.
Sums over all the step - wise hyper - gradients .
def std_collect_hyper_gradients(row_gradients):
        return {hyp: sum([r for r in res[1:]], res[0]) for hyp, res in row_gradients.items()}
def std_collect_hyper_gradients ( row_gradients ) : return { hyp : sum ( [ r for r in res [ 1 : ] ] , res [ 0 ] ) for hyp , res in row_gradients . items ( ) }
Sums over all the step-wise hyper-gradients.
Sums over all the step - wise hyper - gradients .
"""
        Sums over all the step-wise hyper-gradients.

        :param row_gradients: Result of method `backward`
        :return: Hyper-gradients of validation error w.r.t. "fixed" hyperparameters
        """
Hyper-gradients of validation error w.r.t. "fixed" hyperparameters
Hyper - gradients of validation error w . r . t . " fixed " hyperparameters
row_gradients
Result of method `backward`
Result of method ` backward `