1. In a digital medium environment for editing digital visual media, a method of using deep learning to segment objects from digital visual media, the method comprising: generating, by at least one processor with a first neural network, a probability map for an input image, wherein the probability map indicates object pixels predicted to correspond to an object portrayed in the input image; generating, by the at least one processor with a second neural network, a boundary map for the input image, wherein the boundary map indicates edge pixels predicted to correspond to edges of the object portrayed in the input image; based on the probability map and the boundary map, generating, by the at least one processor, a segmentation mask for the object by optimizing a fit between a mask boundary of the object and the edges of the object; and based on the segmentation mask, identifying, by the at least one processor, a set of pixels corresponding to the object portrayed in the input image.