Xbee XB24-ACI range without antenna
I actually figured it out from this article.

http://diychristmas.org/vb1/showthread.php?3086-XBee-Antenna-Types

That blue square I have on the xbees are actually antennas. It claims that it is good for 24 meters which is enough for me.