          """
          logger.debug("Compiling inference model. saved_model: %s", saved_model)
          struct = self._get_filtered_structure()
          model_inputs = self._get_inputs(saved_model.inputs)
          compiled_layers: T.Dict[str, tf.keras.layers.Layer] = {}
          for layer in saved_model.layers:
              if layer.name not in struct:
                  logger.debug("Skipping unused layer: '%s'", layer.name)
                  continue
              inbound = struct[layer.name]
 
</s> remove                        layer: T.Union[keras.models.Model, keras.layers.Layer]) -> dict:
 </s> add                        layer: keras.models.Model | keras.layers.Layer) -> dict: </s> remove         kwargs: T.Dict[str, T.Union[str, int]] = {}
 </s> add         kwargs: dict[str, str | int] = {} </s> remove         predicted: T.List[np.ndarray] = inbound if isinstance(inbound, list) else [inbound]
 </s> add         predicted: list[np.ndarray] = inbound if isinstance(inbound, list) else [inbound] </s> remove         retval: Dict[int, str] = {}
 </s> add         retval: dict[int, str] = {} </s> remove         retval: Dict[int, np.ndarray] = {}
 </s> add         retval: dict[int, np.ndarray] = {}
        compiled_layers: dict[str, tf.keras.layers.Layer] = {}
          """
          logger.debug("Compiling inference model. saved_model: %s", saved_model)
          struct = self._get_filtered_structure()
          model_inputs = self._get_inputs(saved_model.inputs)
        compiled_layers: dict[str, tf.keras.layers.Layer] = {}
          for layer in saved_model.layers:
              if layer.name not in struct:
                  logger.debug("Skipping unused layer: '%s'", layer.name)
                  continue
              inbound = struct[layer.name]
keep keep keep keep replace keep keep keep keep keep
 Rebase code (#1326)

* Remove tensorflow_probability requirement

* setup.py - fix progress bars

* requirements.txt: Remove pre python 3.9 packages

* update apple requirements.txt

* update INSTALL.md

* Remove python<3.9 code

* setup.py - fix Windows Installer

* typing: python3.9 compliant

* Update pytest and readthedocs python versions

* typing fixes

* Python Version updates
  - Reduce max version to 3.10
  - Default to 3.10 in installers
  - Remove incompatible 3.11 tests

* Update dependencies

* Downgrade imageio dep for Windows

* typing: merge optional unions and fixes

* Updates
  - min python version 3.10
  - typing to python 3.10 spec
  - remove pre-tf2.10 code
  - Add conda tests

* train: re-enable optimizer saving

* Update dockerfiles

* Update setup.py
  - Apple Conda deps to setup.py
  - Better Cuda + dependency handling

* bugfix: Patch logging to prevent Autograph errors

* Update dockerfiles

* Setup.py - Setup.py - stdout to utf-8

* Add more OSes to github Actions

* suppress mac-os end to end test 
plugins/train/model/_base/model.py