Small site, multiple layouts
Panels is definitely the easiest way to create different layouts.

What you have to do is go to Panel Content and on the edge of each panel there is a little gear icon or arrow (if i recall correctly) that opens a drop down menu with many options. one of them is "add content", it will open a modal dialog with options to select from blocks the content you want to display, you can also add custom fields if you want!