Additional TX and RX pins for FT232RL Microcontroller Interface
For TTL serial (and other logic devices in general) connecting one output to two inputs is typically OK, but connecting two outputs together is a no-no. In this case with the USB side disconnected the TXO line will be driven high which is the normal idle state for TTL serial. Then the programming port won't be able to reliably drive the line low and even if it can it might cause excessive heat dissipation and component damage.

So you'll want a jumper to switch between TXO on the FTDI module and TX on your programming port so that only one is connected to the RX line on the microcontroller without them being connected together. For the TX output from the microcontroller it shouldn't matter if it's connected to both, as long as you're OK with data being sent to both while programming. It won't cause a problem with the FTDI module but does mean "junk" will be sent out over the USB CDC port if it's connected and open during programming.