1. A segmentation apparatus, comprising: a receiving unit configured to receive gaze data generated by monitoring eye movements of a user viewing spatiotemporal data as a plurality of frames, the gaze data including fixation locations based on the user's gaze throughout the frames; a selection unit configured to select a first frame and a second frame of the frames based on the fixation locations; a segmentation unit configured to perform segmentation on the first and second frames to segment first and second objects, respectively, from the first and second frames based on a region of interest associated with the first and second frames, the region of interest corresponding to a location of one of the fixation locations; a determining unit configured to determine whether the first and second objects are relevant to a segmentation task specified to a user; and a generation unit configured to generate association data to associate the first object with the second object when the first and second objects are determined to be relevant to the segmentation task.