Do Troll's Lairs remain in a region when Hordes of Trolls go In Decline if the only remaing race token is a Horde?
Yes, the Lair is lost, for the reason you say.
It has none of your race counters, so it has been abandoned.
See also: removing declined Lairs when another race goes into decline. (Same reason: the lair gets abandoned)