1. A method of tracking objects of a scene, the method comprising: determining two or more tracks which have merged, each track being associated with at least one of the objects and having a corresponding graph structure, each graph structure comprising at least one node representing the corresponding track; creating a new node representing the merged tracks; adding the graph structures as children nodes of the new node to create a merged graph structure; detecting a split between the objects associated with one of the tracks represented by the nodes of the merged graph structure; determining similarity between one or more of the nodes in the merged graph structure and foreground areas corresponding to split objects; selecting one of the one or more nodes in the merged graph structure based on the determined similarity; and dividing the merged graph structure and creating a new graph structure for tracking the objects in response to the detection of the split, the new graph structure being created from the merged graph structure based on the determined similarity, wherein the new graph structure has the selected node at the root of the new graph structure such that the selected node is distinct or separate from any preceding or prior node, wherein the creation of the new graph structure removes and/or does not have a requirement or condition on having a 1:1 correlation between merged tracks and split tracks, and wherein the new graph structure is monitored, maintained and/or updated by an object tracker, a video object tracker or a processor to track the objects of the scene or the objects in a sequence of images of the scene.