macOS Sierra caps lock disabled in non-latin languages
I have verified that if you use Ukelele to create a duplicate Hebrew keyboard layout (with a different name of course), Caps Lock will function on it like it does in El Capitan.