How to process Dicom Images for CNN?
Can you use zero padding? It's a pre-processing technique for CNNs, it consists in creating a frame of zeros around the image, so that all input image will have the same size.

The CNN will then learn autonomously to ignore the zeros. It's a common technique, Keras layers already have padding built-in arguments.