Neural network design when amount of input neurons vary
The best option in your case would probably be zero padding or padding up. This is simply zeroing out inputs for cases in which there is no data. It's done a lot on the borders of images for CNNs.

That or you could just use a RNN which can handle your variable length inputs with ease.