chunk_content: le%: 0.13308583065659835"
  Setup the optimizer and learning rate scheduler:
  
  
  	Copied
  optimizer = torch.optim.AdamW(model.parameters(), lr=lr)
  lr_scheduler = get_linear_schedule_with_warmup(
      optimizer=optimizer,
      num_warmup_steps=0,
      num_training_steps=(len(train_dataloader) * num_epochs),
  )
  Move the model to the GPU, and then write a training loop to begin!
  
  
  	Copied
  model = model.to(device)
  
  for epoch in range(num_epochs):
      model.