trishv's picture
Upload 2383 files
96e9536
|
raw
history blame
1.85 kB

Exporting πŸ€— Transformers models to ONNX

πŸ€— Transformers provides a transformers.onnx package that enables you to convert model checkpoints to an ONNX graph by leveraging configuration objects.

See the guide on exporting πŸ€— Transformers models for more details.

ONNX Configurations

We provide three abstract classes that you should inherit from, depending on the type of model architecture you wish to export:

  • Encoder-based models inherit from [~onnx.config.OnnxConfig]
  • Decoder-based models inherit from [~onnx.config.OnnxConfigWithPast]
  • Encoder-decoder models inherit from [~onnx.config.OnnxSeq2SeqConfigWithPast]

OnnxConfig

[[autodoc]] onnx.config.OnnxConfig

OnnxConfigWithPast

[[autodoc]] onnx.config.OnnxConfigWithPast

OnnxSeq2SeqConfigWithPast

[[autodoc]] onnx.config.OnnxSeq2SeqConfigWithPast

ONNX Features

Each ONNX configuration is associated with a set of features that enable you to export models for different types of topologies or tasks.

FeaturesManager

[[autodoc]] onnx.features.FeaturesManager