ALTER DATABASE MODIFY FILEGROUP [filegroup] AUTOGROW_ALL_FILES
It seems there is no way around it.  This is per an offline conversation with Paul Randal from SQL Skills.  So that would mean I would need to either have no other open sessions on the db, or set it to single user mode prior to running the set statement.  Thanks for the assistance Paul.