1. A computer-implemented method for training a convolutional neural network (CNN) that is pre-trained using a set of color images, the method comprising: receiving, using an input module of a system memory, a training dataset including a plurality of multidimensional images, each multidimensional image including a color image and a depth image; performing, using a processor, a fine-tuning of the pre-trained CNN using the depth image for each of the plurality of multidimensional images; obtaining, using the cross-trained CNN module in the system memory, a depth CNN based on the pre-trained CNN, the depth CNN includes at least one convolutional layer in communication with an ultimate fully-connected layer via a penultimate fully-connected-layer, wherein the depth CNN is associated with a first set of parameters; replicating, using the cross-trained CNN module, the depth CNN to obtain a duplicate depth CNN being initialized with the first set of parameters; and obtaining, using the cross-trained CNN module, a depth-enhanced color CNN based on the duplicate depth CNN being fine-tuned using the color image for each of the plurality of multidimensional images, the depth-enhanced color CNN includes at least one convolutional layer in communication with an ultimate fully-connected layer of the depth-enhanced color CNN via a penultimate fully-connected-layer of the depth-enhanced color CNN, wherein the depth-enhanced color CNN is associated with a second set of parameters.