How to make a rough gravel terrain?
A particle system with Dupli-group is probably a good way to go.

I'd start by creating a dozen or so rock templates. Using modifiers, you can come up with this pretty fast:



Then create a new plane that will serve as the base of where the rocks will go, and create a particle system to it. The particles system controls where the rocks will go, distribution, size, etc.