Panels and pager in the pane
If I understand the question correctly, you need to set the Use panel path to Yes in order for things like pagers, exposed filters/exposed sorting, and ajax to work properly.