The non-triviality of the (additional) conjugacy conclusion can be illustrated with the Klein four-group V as the non-example.
The quaternion group has normal subgroups of order 4 and 2 but is not a [semi]direct product.