PyTorch lightening resume training from last epoch and weights
I am using PyTorch Lightening trainer for pre-training a large model. I know I can resume training from old weights but that does not contain old hyper-parameters (lr, last_epoch, etc.). Is there any automatic way to resume training? OR Do I need to overload Checkpoint Callback or CSVLogger to search for old cvs logs and get last epoch number?

Instead of load from checkpoint, use resume_from_checkpoint in trainer.
# resume from a specific checkpoint
trainer = Trainer(resume_from_checkpoint=&quot;some/path/to/my_checkpoint.ckpt&quot;)

See more details here https://pytorch-lightning.readthedocs.io/en/stable/common/trainer.html#resume-from-checkpoint .
