Display field's label only when any value added to it
almost you did , instead of content.FIELD_MACHINENAME use node.FIELD_MACHINENAME.value
I mean try something like 

{% if node.field_tag.value %}
{{ content.field_tag }}
{% endif %}


for make sure that this solution work correctly(for debug) try {{ kint(node.field_tag }}.