Left click selection deselect object (2.8)
I'm not sure if this is what you are looking for, but if you:

*Left Click and drag = Select the objects.

*Ctrl + Left click and drag = Deselect.

*Shift + Left Click = Add Objects to the selection.

*Shift + Double Left Click on an object = Deselect 



Hope that helps.

Good Luck.