Keras: X and Y are the same, yet validation accuracy is 50%, what is wrong?
You should think about how the initial values impact the ReL Units. If, for example, you use init='one' for the activation='relu' layer you'll get the desired result (in this simple setup).