2D Animation keyframe issue
Okay so I figured it out and will post the answer just in case a new 2D animator runs into the same issue.

The problem I had is solved with setting keyframes for the new layers (ink, color, shadows, highlights, etc..) on another frame in the dopesheet.
Because I had those layers only active on 1 frame in the dopesheet the image showed through the whole animation.