Problems with extruded curve and solidify modifier
It seems logic that if your angle is very sharp, your Solidify modifier may create a problem, because the thickness profile can easily overlap itself. So I guess what you have to do is either change the Thickness to a negative value (in your case), or convert your curve to mesh and bring some corrections manually.