How to select all the vertexes with border select?
That is the regular behaviour of Blender. By default "Limit selection to visible (clipped with depth buffer)" is enabled.

When you disable the button I marked in the screenshot, select the vertices again, all four vertices will be selected.