Is this number a factorial?
Brachylog, 1 byte
ḟ

Try it online!
Explanation
ḟ is a built-in that asserts the following relation: its  output is the factorial of its input. We simply give it a set output and see whether it suceeds or not with a variable input.