Nowadays elders, often find it difficult to keep track of their cognitive and functional abilities required for remaining independent in their homes. Ambient Assisted Living (AAL) are the Ambient Intelligence based technologies for the support of daily activities to elders. Traditional rehabilitation is an example of a common activity elders may require and that usually implies they move to the rehabilitation clinics, which is the main reason for treatment discontinuation. Tele-rehabilitation is a solution that not only may help elders but also their family members and health professionals to monitor elder's treatment. The purpose of this paper is to present a tele-rehabilitation system that uses the motion-tracking sensor of the Kinect, to allow the elderly users natural interaction, combined with a set of external sensors as a form of input. Data fusion techniques are applied in order to integrate these data for detecting right movements and to monitor elder's treatment in the rehabilitation process.