# Fixed-roberta-base

[roberta-base](https://huggingface.co/roberta-base) but with a resized embedding matrix and an extra dim in the token type embedding matrix for better sharding/partitioning.
{}
transformers jax roberta feature-extraction endpoints_compatible region:us
TAGS
#transformers #jax #roberta #feature-extraction #endpoints_compatible #region-us 

# Fixed-roberta-base

roberta-base but with a resized embedding matrix and an extra dim in the token type embedding matrix for better sharding/partitioning.
# Fixed-roberta-base

roberta-base but with a resized embedding matrix and an extra dim in the token type embedding matrix for better sharding/partitioning.
TAGS
#transformers #jax #roberta #feature-extraction #endpoints_compatible #region-us 
 # Fixed-roberta-base

roberta-base but with a resized embedding matrix and an extra dim in the token type embedding matrix for better sharding/partitioning.
passage: TAGS
#transformers #jax #roberta #feature-extraction #endpoints_compatible #region-us 
# Fixed-roberta-base

roberta-base but with a resized embedding matrix and an extra dim in the token type embedding matrix for better sharding/partitioning.