Custom ukelele layout - cmd-w and similar shortcuts not working
So the problem is solved by going to Modifiers tab and adding one for CMD down key, then selecting to switch to QWERTY layout when CMD is pressed. Same can be repeated for CMD+SHIFT down.