Track to in animation nodes
You can use a second Offset Matrix node with rotation mode to achieve the desired result.



The rotation itself is calculated with the Direction to Rotation node, like you assumed.
The direction has to be calculated from the already translated planes, otherwise the vectors would be incorrect. You can get them with a Decompose Matrix node from the first Offset Matrix.