Distribute macOS build of a SwiftUI app using Sign In with Apple
Sadly it seems like it's an issue with Apple's tooling. See also https://forums.developer.apple.com/thread/129263.

Nothing to do but remove Sign In with Apple (not an option for me), or simply wait for Apple to fix this :(