Load file based on line number in sqlldr
skip=N is what you're looking for. Skips the first N rows, so in your case you just want to skip the first. 

OPTIONS(skip=1)
LOAD DATA
... rest of normal control file