USB Termination Resistor
On a prototype I built I made the same mistake. I got away with it with a short USB cable (0.5m) but when I tried a long one (3m) I could not get it to work reliably.

Needless to say the production units have these resistors and work reliably with both long and short cables.