Enormous dataset, how to proceed?
Are you constrained to use only R or Python? If you have the option, try using Alteryx. It's a GUI based tool which has greatly helped me explore and analyze large volumes of data. The tool is built on R so plugging in R functions is a breeze too.