iTunes import settings for files on computer
Still not sure about the batch importing, but I did find some UX confusion in iTunes 11 that led to my posting this question. There's two different columns in the song view: "iCloud Status" and "iCloud Download". Just seeing the iCloud icon in a column by itself led me to believe it'd be filled in as the songs were uploaded. Not true, check "iCloud Status" as well.