he and his men had travelled back with other highland drovers in groups , forty or fifty strong , keeping to the drove trails and sleeping in the same encampments which they had used on the way down .