Are used to and 以往 really the same?
以 here means 


  用在方位词前，表明时间、方位、方向或数量的界限：以前。以内。（from 在线新华字典）


In a way it is similar to -wards suffix, as in backwards, in English.

往 means past.

以往 literally means before this point of time, 'past-wards'.