Cranial Nerve Decussation
As you mentioned, the resulting impairment depends on the level of the injury: nuclear, fascicular, central / peripheral. So, you should differentiate lesions inside the brain tissue (which can be at nucleus, at any location of a tract, before crossing or after, and outside. From this, the first thing we should explain is the normal anatomy.  From normal anatomy we can understand the pathology.

One interesting fact you probably wanted to know is that Optic Nerve it not a real nerve in a classic definition, because it begins outside the brain as grouping axons of RGCs (retinal ganglion cells) and after leaving the eye becomes a “nerve”. From this, you can understand its damage better, because the damage to the visual fields depends on the level of insult. 

IV nerve is the only cranial nerve that completely crossed (decussated). Thus, the lesion before the crossing/decussation (you were right mentioning the nucleus, but we extend the “region” until the decussation) will cause palsy and consequent atrophy contralaterally to the lesion. After the decussation the palsy and atrophy will be ipsilateral.

Considering cranial nerve XII we should speak about nuclear-infranuclear and supranuclear damage and with this notion supranuclear damage will cause contralateral transient tongue paresis. Nuclear-infranuclear damage will cause more permanent palsy, which is mostly bilateral because the nuclei are close to each other.

Considering VII pair, nuclear-intranuclear damage (“peripheral”) will cause ipsilateral hemifacial palsy including the brow and eyelid, while supranuclear (“central”) lesion will cause contralateral facial palsy with brow/eyelid sparing.