Is there anyway to have multiple directories for loading fonts in Linux distros? Or loading the fonts from a directory inside `.fonts` such as `.fonts/DIRECTORY`?

I have two sets of fonts, and I don't want to mix them in `.fonts` directory.