Keyboard Fn Function key switchUsing language
Using Fn to switch keyboards is new with Big Sur.  Buggy behavior has been reported by many users in the Apple discussion forums.  Until Apple fixes it, probably best to use the traditional shortcuts found in System Preferences/Keyboard/Shortcuts.
I understand MacOS 11.2 should fix this problem when released.