What do we know about the transfer function away from its zeros?
The response of the filter at any frequency $\omega \in [-\pi, \pi)$ can be found by substituting $z = e^{-j\omega}$ (i.e. a position on the unit circle at an angle of $\omega$) into the transfer function. The resultant $H(e^{j\omega})$ is often referred to as a discrete-time system's frequency response. Most of the time, you're primarily concerned about the magnitude response of the system, so you will often see $|H(e^{j\omega)}|$ specifically considered in a system design.

When designing a filter, there will often be a region of frequencies that you would like "left alone;" this is called the filter passband. I wouldn't say that the presence of zeros elsewhere in the $z$-plane results in multiplying these frequencies by random complex numbers; indeed, the response at any frequency is well-defined. Design methods for digital filters that have flat passbands will yield a transfer function whose zeros are carefully placed such that the filter response is approximately unity in those regions (assuming no filter gain). The amount of allowed deviation from this ideal response is a design parameter that you often have at your disposal to control the required complexity of the filter.

So, to more pointedly answer your question, if you know all of the zeros of an FIR filter, then you know everything about its transfer function, at every point in the $z$-plane (and therefore everywhere on the unit circle).