In the graph search version of A*, can I stop the search the first time I encounter the goal node?
No, the optimal path is found when you pop the goal state. If you stop the search when you first add the goal state then the final path may not be optimal.