Iphone advice for plan involving only texting and calling
Use the built-in restrictions on the iPhone and disallow to Installing apps as well as Safari. (see this document from Apple.

If you wait for iOS 10 which is due this fall you'll then be able to actually remove most apps which might help out even more.