Connecting an auxiliary cable into three out of 9 serial pins
Figure 1. RS232 on stereo jack.

It's most likely wired like this. Pin 5 and the sleeve (1) of the jack are always GND (ground) or COM (common). Pins 2 and 3 are transmit and receive. If it doesn't work one way then swap 2 and 3.