Edit 536 lines due to type mismatch error when evaluation

The specific error message is as follows:
RuntimeError: Index put requires the source and destination dtypes match, got BFloat16 for the destination and Float for the source.

modeling_magma.py

@@ -533,7 +533,8 @@ class MagmaForCausalLM(MagmaPreTrainedModel):
                     f" the number of image given to the model is {num_images}. "
                     f"This prevents correct indexing and breaks batch generation."
                 )
-        final_embedding[image_to_overwrite] = image_features.contiguous().reshape(-1, embed_dim).to(target_device)
+        # final_embedding[image_to_overwrite] = image_features.contiguous().reshape(-1, embed_dim).to(target_device)
+        final_embedding[image_to_overwrite] = image_features.contiguous().reshape(-1, embed_dim).to(target_device).to(torch.bfloat16)
         final_attention_mask |= image_to_overwrite
         position_ids = (final_attention_mask.cumsum(-1) - 1).masked_fill_((final_attention_mask == 0), 1)