rllib/policy/torch_policy.py
def extra_action_out(
        self,
        input_dict: Dict[str, TensorType],
        state_batches: List[TensorType],
        model: TorchModelV2,
        action_dist: TorchDistributionWrapper,
    ) -> Dict[str, TensorType]:
        """Returns dict of extra info to include in experience batch.

        Args:
            input_dict: Dict of model input tensors.
            state_batches: List of state tensors.
            model: Reference to the model object.
            action_dist: Torch action dist object
                to get log-probs (e.g. for already sampled actions).

        Returns:
            Extra outputs to return in a `compute_actions_from_input_dict()`
            call (3rd return value).
        """
        return {}
Returns dict of extra info to include in experience batch.

        Args:
            input_dict: Dict of model input tensors.
            state_batches: List of state tensors.
            model: Reference to the model object.
            action_dist: Torch action dist object
                to get log-probs (e.g. for already sampled actions).

        Returns:
            Extra outputs to return in a `compute_actions_from_input_dict()`
            call (3rd return value).
        
Returns dict of extra info to include in experience batch.
Returns dict of extra info to include in experience batch .
def extra_action_out(
        self,
        input_dict: Dict[str, TensorType],
        state_batches: List[TensorType],
        model: TorchModelV2,
        action_dist: TorchDistributionWrapper,
    ) -> Dict[str, TensorType]:
        return {}
def extra_action_out ( self , input_dict : Dict [ str , TensorType ] , state_batches : List [ TensorType ] , model : TorchModelV2 , action_dist : TorchDistributionWrapper , ) -> Dict [ str , TensorType ] : return { }
Returns dict of extra info to include in experience batch.
Returns dict of extra info to include in experience batch .
"""Returns dict of extra info to include in experience batch.

        Args:
            input_dict: Dict of model input tensors.
            state_batches: List of state tensors.
            model: Reference to the model object.
            action_dist: Torch action dist object
                to get log-probs (e.g. for already sampled actions).

        Returns:
            Extra outputs to return in a `compute_actions_from_input_dict()`
            call (3rd return value).
        """
Extra outputs to return in a `compute_actions_from_input_dict()`
call (3rd return value).
Extra outputs to return in a ` compute_actions_from_input_dict () ` call ( 3rd return value ) .
self
input_dict
Dict[str, TensorType]
Dict of model input tensors.
Dict of model input tensors .
state_batches
List[TensorType]
List of state tensors.
List of state tensors .
model
TorchModelV2
Reference to the model object.
Reference to the model object .
action_dist
TorchDistributionWrapper
Torch action dist object
to get log-probs .
Torch action dist object to get log - probs .