Internet Connection Sharing also includes a local DNS resolver in Windows XP to provide name resolution for all network clients on the home network, including non-Windows-based network devices.
There is basic but production quality support in Windows XP for IPv6 and Teredo tunneling through the Advanced Networking Pack later incorporated into Windows XP SP2.