Is it possible to adb connect android via wifi without configuring port on android?
No. What you're doing there is not just setting a port number away from the default: setting the number at all is what causes the device to start listening. Before you run the steps in the question, the device isn't listening for adb connections on any port at all.

For this reason, there's no "default port" to connect to without setting anything up on the device.