Suitable modelling approach to incorporate different signals
Combing multiple models together is called typically ensembling.
You are describing hierarchical ensembling. There are simpler methods for ensembling, such as voting and weighted voting.