Multi-Stream: device ordinal
Hi @d0k Can you please review this PR ? Thank you! Hi @buptzyb Can you please resolve conflicts? Thank you! This PR is stale because it has been open for 14 days with no activity. It will be closed if no further activity occurs. Thank you. Hi @buptzyb Can you please resolve conflicts? Thank you! Hi @buptzyb I'm going to go ahead and close this PR, because it seems to have stalled. If you're still interested in pursing this (and responding to my comments), please feel free to reopen! Thank you for you contribution!
This PR works as a part of the whole Multi-Stream feature in TF, which is proposed in #61185.

Implement DeviceOrdinalHelper to encode/decode stream and device information into/from the ordinal variable, and use it to create multiple allocators when necessary.

@changhuilin