Determining which entries in input vector have the greatest effect on output vector
I'm not very experienced in the interpretation of neural networks but I have two suggestions. 
1: Alter the values of the input, one feature at a time, and watch how the output varies.
2: Use another model with more interpretability. You could do this just for interpretation.