I am trying to migrate a Drupal site to a new host. In the tutorials I read I need an .sql export of the database, as well as the files (I have these). I don't have access to the old hosting phpmyadmin method but I used backup and migrate module on Drupal which created a file with .mysql extension.

After a few failed attempts at migrating, new host support says they need a .sql file

From what I see in my searches here, some have mentioned simply changing the extension of the file.

Can I just change the .mysql extension to .sql and give that to my new host - is it really that simple?