It's Hip to be Square
Neim, 2 bytes

q


Explanation:

q      Push an infinite list of squares
      Is the input in that list?


When I say 'infinite' I mean up until we hit the maximum value of longs (2^63-1). However, Neim is (slowly) transitioning to theoretically infinitely large BigIntegers.

Try it!