I need to find Simplest exercises available for learning neural networks
I'm learning myself too and I found kaggle.com and excellent resource for learning and practice, they have lots of data sets available for you to try your own models.

There is also a learn section with lots of topics for beginners

Hope that helps.