Displacement modifier breaks mesh
This is because your mesh is splitted into Flat parts (Probably because you used an Edge Split Modifier).

To combine it and have it not "Break" you can enter edit mode, select all vertices and press W then Remove Doubles.

Not related to the question:

I would recommend you remesh your object to get a better toplogy using the Remesh Modifier