Remove pager from frontpage
I figured out what I was doing wrong. It had to do with the defaults of the page view path. 

In the Front Page View I changed the page settings path to /home and went into 
Configuration >> Site information and scrolled down to the Front Page settings.

I set the default front page url to home and the pager was removed as per my configuration of the frontpage Page pager settings.