index.php in output HTML - channel pages
I'd suggest starting with the official docs on removing index.php from your URLS:

https://craftcms.com/support/remove-index.php

https://craftcms.com/support/why-index.php

And if that doesn't help, there are lots more environment-specific things here on Craft SE, you can check.