Is there a way to remove tabs inside panels?
From memory, I believe the answer is no, because the tabs are rendered outside of the area that Panels is responsible for.

If you use Panels everywhere, then you can simply leave the tabs out however, "In panels". If you don't, the rendering is probably happening in page.tpl.php instead.