PR #9778: Added flash attention with new cudnn frontend
PR #9778: Added flash attention with new cudnn frontend

Imported from GitHub PR https://github.com/openxla/xla/pull/9778

This is the second attempt at #9528.
Copybara import of the project:

--
77a644020c82939ea89c717c3490b5469d35e175 by Shraiysh Vaishay <svaishay@nvidia.com>:

Added flash attention with new cudnn frontend

Merging this change closes #9778

FUTURE_COPYBARA_INTEGRATE_REVIEW=https://github.com/openxla/xla/pull/9778 from shraiysh:flash-attn-2 77a644020c82939ea89c717c3490b5469d35e175
