title: what will happen if PIG process 1 TB of data with default setting?
body: <p>i read that PIG will assign the number of reducers based on the input file size. For each GB a reducer would be allocated and the maximum will be of 999 reducers which is default.(<strong>i know it can be changed in <em>pig.exec.reducers.max</em></strong>).what will happen or how the reducers will be allocated if i process a TB of data with a default setting? </p>