Weird heightmap borders
it might be because of the texture.
one quick solution is to make a uv on the object and make it a little bigger then the texture and after that set the Displace modifier to use you uv in texture coordinate options.