Ports in the TimeCapsule
Yes, that is the port you'll use. If you use one of the other ports, Internet access will sometimes work but the device will think it won't. 

Use the WAN port for your apartment's inbound Internet (whether an Ethernet cable or from an ADSL or cable modem), and the other three ports for outbound to your local machines that aren't on wireless.