spacy_transformers/architectures.py
def transformer_listener_tok2vec_v1(
    pooling: Model[Ragged, Floats2d], grad_factor: float = 1.0, upstream: str = "*"
) -> Model[List[Doc], List[Floats2d]]:
    """Create a 'TransformerListener' layer, which will connect to a Transformer
    component earlier in the pipeline.

    The layer takes a list of Doc objects as input, and produces a list of
    2d arrays as output, with each array having one row per token. Most spaCy
    models expect a sublayer with this signature, making it easy to connect them
    to a transformer model via this sublayer.
    Transformer models usually operate over wordpieces, which usually don't align
    one-to-one against spaCy tokens. The layer therefore requires a reduction
    operation in order to calculate a single token vector given zero or more
    wordpiece vectors.

    pooling (Model[Ragged, Floats2d]): A reduction layer used to calculate
        the token vectors based on zero or more wordpiece vectors. If in doubt,
        mean pooling (see `thinc.layers.reduce_mean`) is usually a good choice.
    grad_factor (float): Reweight gradients from the component before passing
        them upstream. You can set this to 0 to "freeze" the transformer weights
        with respect to the component, or use it to make some components more
        significant than others. Leaving it at 1.0 is usually fine.
    upstream (str): A string to identify the 'upstream' Transformer
        to communicate with. The upstream name should either be the wildcard
        string '*', or the name of the `Transformer` component. You'll almost
        never have multiple upstream Transformer components, so the wildcard
        string will almost always be fine.
    """
    listener = TransformerListener(upstream_name=upstream)
    model = chain(listener, trfs2arrays(pooling, grad_factor))
    model.set_ref("listener", listener)
    return model
Create a 'TransformerListener' layer, which will connect to a Transformer
    component earlier in the pipeline.

    The layer takes a list of Doc objects as input, and produces a list of
    2d arrays as output, with each array having one row per token. Most spaCy
    models expect a sublayer with this signature, making it easy to connect them
    to a transformer model via this sublayer.
    Transformer models usually operate over wordpieces, which usually don't align
    one-to-one against spaCy tokens. The layer therefore requires a reduction
    operation in order to calculate a single token vector given zero or more
    wordpiece vectors.

    pooling (Model[Ragged, Floats2d]): A reduction layer used to calculate
        the token vectors based on zero or more wordpiece vectors. If in doubt,
        mean pooling (see `thinc.layers.reduce_mean`) is usually a good choice.
    grad_factor (float): Reweight gradients from the component before passing
        them upstream. You can set this to 0 to "freeze" the transformer weights
        with respect to the component, or use it to make some components more
        significant than others. Leaving it at 1.0 is usually fine.
    upstream (str): A string to identify the 'upstream' Transformer
        to communicate with. The upstream name should either be the wildcard
        string '*', or the name of the `Transformer` component. You'll almost
        never have multiple upstream Transformer components, so the wildcard
        string will almost always be fine.
    
Create a 'TransformerListener' layer, which will connect to a Transformer
component earlier in the pipeline.

The layer takes a list of Doc objects as input, and produces a list of
2d arrays as output, with each array having one row per token. Most spaCy
models expect a sublayer with this signature, making it easy to connect them
to a transformer model via this sublayer.
Transformer models usually operate over wordpieces, which usually don't align
one-to-one against spaCy tokens. The layer therefore requires a reduction
operation in order to calculate a single token vector given zero or more
wordpiece vectors.

pooling (Model[Ragged, Floats2d]): A reduction layer used to calculate
the token vectors based on zero or more wordpiece vectors. If in doubt,
mean pooling  is usually a good choice.
grad_factor (float): Reweight gradients from the component before passing
them upstream. You can set this to 0 to "freeze" the transformer weights
with respect to the component, or use it to make some components more
significant than others. Leaving it at 1.0 is usually fine.
upstream (str): A string to identify the 'upstream' Transformer
to communicate with. The upstream name should either be the wildcard
string '*', or the name of the `Transformer` component. You'll almost
never have multiple upstream Transformer components, so the wildcard
string will almost always be fine.
Create a ' TransformerListener ' layer which will connect to a Transformer component earlier in the pipeline . The layer takes a list of Doc objects as input and produces a list of 2d arrays as output with each array having one row per token . Most spaCy models expect a sublayer with this signature making it easy to connect them to a transformer model via this sublayer . Transformer models usually operate over wordpieces which usually don ' t align one - to - one against spaCy tokens . The layer therefore requires a reduction operation in order to calculate a single token vector given zero or more wordpiece vectors . pooling ( Model [ Ragged Floats2d ] ) : A reduction layer used to calculate the token vectors based on zero or more wordpiece vectors . If in doubt mean pooling is usually a good choice . grad_factor ( float ) : Reweight gradients from the component before passing them upstream . You can set this to 0 to " freeze " the transformer weights with respect to the component or use it to make some components more significant than others . Leaving it at 1 . 0 is usually fine . upstream ( str ) : A string to identify the ' upstream ' Transformer to communicate with . The upstream name should either be the wildcard string ' * ' or the name of the ` Transformer ` component . You ' ll almost never have multiple upstream Transformer components so the wildcard string will almost always be fine .
def transformer_listener_tok2vec_v1(
    pooling: Model[Ragged, Floats2d], grad_factor: float = 1.0, upstream: str = "*"
) -> Model[List[Doc], List[Floats2d]]:
    listener = TransformerListener(upstream_name=upstream)
    model = chain(listener, trfs2arrays(pooling, grad_factor))
    model.set_ref("listener", listener)
    return model
def transformer_listener_tok2vec_v1 ( pooling : Model [ Ragged , Floats2d ] , grad_factor : float = 1.0 , upstream : str = "*" ) -> Model [ List [ Doc ] , List [ Floats2d ] ] : listener = TransformerListener ( upstream_name = upstream ) model = chain ( listener , trfs2arrays ( pooling , grad_factor ) ) model . set_ref ( "listener" , listener ) return model
Create a 'TransformerListener' layer, which will connect to a Transformer
component earlier in the pipeline.
Create a ' TransformerListener ' layer which will connect to a Transformer component earlier in the pipeline .
"""Create a 'TransformerListener' layer, which will connect to a Transformer
    component earlier in the pipeline.

    The layer takes a list of Doc objects as input, and produces a list of
    2d arrays as output, with each array having one row per token. Most spaCy
    models expect a sublayer with this signature, making it easy to connect them
    to a transformer model via this sublayer.
    Transformer models usually operate over wordpieces, which usually don't align
    one-to-one against spaCy tokens. The layer therefore requires a reduction
    operation in order to calculate a single token vector given zero or more
    wordpiece vectors.

    pooling (Model[Ragged, Floats2d]): A reduction layer used to calculate
        the token vectors based on zero or more wordpiece vectors. If in doubt,
        mean pooling (see `thinc.layers.reduce_mean`) is usually a good choice.
    grad_factor (float): Reweight gradients from the component before passing
        them upstream. You can set this to 0 to "freeze" the transformer weights
        with respect to the component, or use it to make some components more
        significant than others. Leaving it at 1.0 is usually fine.
    upstream (str): A string to identify the 'upstream' Transformer
        to communicate with. The upstream name should either be the wildcard
        string '*', or the name of the `Transformer` component. You'll almost
        never have multiple upstream Transformer components, so the wildcard
        string will almost always be fine.
    """
pooling
Model[Ragged, Floats2d]
grad_factor
float
upstream
str