1. An article of manufacture including program code which, when executed by a machine, causes the machine to perform the operations of: determining a duplicated node to remove from a first parallelized code region; and inserting a communication operation, when executed, to fulfill a dependence associated with the duplicated node removed from the first parallelized code region.