1. A method of programming non-volatile storage, comprising: providing a first column address to a first bay of non-volatile storage elements, wherein the first column address is associated with a first column that includes non-volatile storage elements in the first bay and a second bay of non-volatile storage elements; while providing the first column address to the first bay, providing a second column address to the second bay of non-volatile storage elements, wherein the second column address is associated with a second column that includes non-volatile storage elements in the first bay and the second bay; and in response to the first column address and the second column address, simultaneously programming in a first column address cycle a first portion of the first column of non-volatile storage elements in the first bay and a second portion of the second column of non-volatile storage elements in the second bay.