We present EasyHouse, a system developed to allow people with disabilities and their family members to control their home environment (e.g., turn on/off a light, turn on/off the TV) using a smartphone. The user interface was designed to be adjustable to the needs of each user. The development of EasyHouse followed an iterative user-centered design approach. A paper-based low-fidelity prototype was built based on user requirements and from the first author's own experience as a researcher with cerebral palsy. After several design and evaluation iterations, a functional prototype has been evaluated in a real context with real users. Preliminary results indicate that the proposed system is suitable for both people with and without motor disabilities, and provides an adequate method for controlling home appliances when there is a family member with motor disabilities.