In this paper, we propose an innovative approach that enables two or more users to manipulate an object collaboratively. Our goal is to benefits from the wide variety of todays VR devices. Therefore, our solution is based on an asymmetric collaboration pattern at different scales in which users benefit from suited points of views and interaction techniques according to their device setups. Indeed, each user application is adapted thanks to plasticity mechanisms. Our system provides an efficient way to co-manipulate an object within irregular and narrow courses, taking advantages of asymmetric roles in synchronous collaboration. Moreover, its aims to provide a way to maximize the filling of the courses while the object moves on its path.