Integrating USB Camera on TI Hercules Evaluation Kit (ARM Cortex R4)
I am answering my own question. 
This was not feasible, because I wanted to capture 30 frames per second and for such high rates USB 2.0 is a must. My board does not support USB 2.0

Also there were not many sample USB driver codes available for this board.