How do I know how to construct the layers of my CNN
There isn't a formula behind it - layer sizes are selected with a lot of trial and error (often automated by cross-validation). But saying "I've used an architecture from a network from a similar problem, or at least from the same domain" is a legitimate answer.