Is it possible to drill through a peltier?
Perhaps (drilling ceramic is not trivial), but it won't work anymore. 

The junctions are spread out over the surface and they are in series so damaging one connection breaks the string. It might be possible to jumper over the damaged sections, but I doubt it would be effective. 

You can see the little blocks in the edge view of your 2nd photo.