Two pagers for a single view
If i understand correctly this is not possible out of the box with your current setup and views only. Could you split the view into 2 seperate views instead? Use the second one as attachment for the first. So you could define the pager for each view. You could also look into Views Field View Module. With node specific pagers created with the Entity Pager Module it could possibly work even with your current setup.