Number of calls of hook_node_access
Next time I should look into the docs first...

According to node_access(), it doesn't consider the returned value NODE_ACCESS_IGNORE, which I return, if the user doesn't violate my permissions, so that other modules still can deny access, if their permissions might be violated.

So the answer of my question is: I should use drupal_static() to avoid duplicate calculations.