Complex text (curve) to mesh creates gaps
Using extrude in the font properties in Blender proved to be the right way. 

In my question I had created a text, then converted to mesh and finally extruded with 'e' - that created the broken mesh. A lot of unnecessary steps that also rendered a bad result.