Why does 10k ohm pull down resistor not work for pushbutton with NOT logic gate?
TTL logic and its descendants all source current into the inputs when low.

In the case of LSTTL it will source about 0.4mA - this will cause a voltage to be developed across the 10k resistor such that the input is seen as a logic '1'.

If you change the resistor to 1.5k or less it should work. (As corrected by Trevor)

The recommend way to interface switches etc is to connect one side of the switch to ground with the other to the logic input and connect a pull-up form the input to +5V. In this case the resistor can be 10K because the leakage current of the input is only 40uA or less.

The TTL family is often know as current-sinking logic because of this behavior.  The more modern CMOS logic does not have this behavior and would have worked as drawn although even then the favored arrangement is to connect the switch on the grounded side with a pull-up.

A similar issue occurs on the output - because it is designed to sink current from the logic inputs it works bette pulling low than pulling high.  LS logic can pull about 8mA low but only 400uA high. (74LS04 datasheet)

It is better to connect the LED to 5V and a series resistor to the gate output for this reason.  The LED will be on when the output is low rather than high.