How to get displacement working on a completed house? I made a house with blender but how can I apply displacement modifiers only to the walls and not to the whole object?
You can create vertex groups in edit mode and attach them to the displacement modifier. 


Select your wall's vertices.
Press space and search for add vertex group
Assign the vertex group to the modifier.