Assertion failure in `tf.signal.irfft/irfft2d/irfft3d`
Hi @x0w3n ,
- I was able to reproduce the issue on Colab using TF v2.16.1 and TF-nightly ,Please find the [gist](https://colab.research.google.com/gist/Venkat6871/339ff14afb0d1eab6d1a3c0dbdc4697d/69229_2-16-1-nightly-v.ipynb) here for reference.

Thank you! Thank you for your response. Are you satisfied with the resolution of your issue?
<a href="https://docs.google.com/forms/d/e/1FAIpQLSfaP12TRhd9xSxjXZjcZFNXPGk4kc1-qMdv3gc6bEP90vY1ew/viewform?entry.85265664=Yes&entry.2137816233=https://github.com/tensorflow/tensorflow/issues/69229">Yes</a>
<a href="https://docs.google.com/forms/d/e/1FAIpQLSfaP12TRhd9xSxjXZjcZFNXPGk4kc1-qMdv3gc6bEP90vY1ew/viewform?entry.85265664=No&entry.2137816233=https://github.com/tensorflow/tensorflow/issues/69229">No</a>

### Issue type

Bug

### Have you reproduced the bug with TensorFlow Nightly?

Yes

### Source

source

### TensorFlow version

tf 2.16

### Custom code

Yes

### OS platform and distribution

Linux Ubuntu 22.04.3 LTS (x86_64)

### Mobile device

_No response_

### Python version

3.9.13

### Bazel version

_No response_

### GCC/compiler version

_No response_

### CUDA/cuDNN version

_No response_

### GPU model and memory

_No response_

### Current behavior?

Assertion failure when entering boundary values for tf.signal.irfft/irfft2d/irfft3d parameters and trigger crash

### Standalone code to reproduce the issue

```shell
import tensorflow as tf
import numpy as np

x = np.array([[[0]]])      
y = tf.signal.irfft(x)     # crash 
# y = tf.signal.irfft2d(x)   # crash
# y = tf.signal.irfft3d(x)   # crash
```


### Relevant log output

```shell
2024-06-05 11:32:13.365512: I tensorflow/core/platform/cpu_feature_guard.cc:210] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
DUCC FFT c2r failed: 
bazel-out/k8-opt/bin/external/ducc/_virtual_includes/fft/ducc/src/ducc0/fft/fft1d_impl.h: 2948 (static Trpass<Tfs> ducc0::detail_fft::rfftpass<float>::make_pass(size_t, size_t, size_t, const Troots<Tfs> &, bool) [Tfs = float]):

Assertion failure
no zero-sized FFTs

Aborted (core dumped)
```
