Requiring a package doesn't find a dependency
As reported in Composer fails when installing a dependency of a dependency, but not when the dependency is installed directly. that probably happens because the root composer.json file doesn't set a minimum stability, or doesn't accept a less stable package.

Try with composer require drupal/commerce:@dev as suggested in that issue report.