This work describes a new human-in-the-loop (HitL) assistive grasping system for individuals with varying levels of physical capabilities. We investigated the feasibility of using four potential input devices with our assistive grasping system interface, using able-bodied individuals to define a set of quantitative metrics that could be used to assess an assistive grasping system. We then took these measurements and created a generalized benchmark for evaluating the effectiveness of any arbitrary input device into a HitL grasping system. The four input devices were a mouse, a speech recognition device, an assistive switch, and a novel sEMG device developed by our group that was connected either to the forearm or behind the ear of the subject. These preliminary results provide insight into how different interface devices perform for generalized assistive grasping tasks and also highlight the potential of sEMG based control for severely disabled individuals.
@cite_9: Limb repositioning is necessary for individuals with severe physical disabilities to sustain muscle strength and prevent pressure sores. As robotic technologies become ubiquitous, these tools offer promise to support the repositioning process. However, research has yet to focus on ways in which individuals with severe physical disabilities can control robots for these tasks. This paper presents a study that examines the needs and attitudes of potential users with physical disabilities to control a robotic aid for limb repositioning. Subjects expressed interest in using brain---computer interface (BCI) and speech recognition technologies for purposes of executing robotic tasks. The performance of four subjects controlling arm movements on an avatar through the keyboard, mouse, BCI, and Dragon NaturallySpeaking speech recognition was evaluated. Although BCI and speech technologies may limit physical fatigue, more challenges were faced using BCI and speech conditions compared to the keyboard and mouse. This research promotes accessibility into mainstream robotic technologies and represents the first step in the development of a robotic prototype using a BCI and speech recognition technologies for limb repositioning.
@cite_6: We present a heuristic-based search method for path planning in shared human-robot control scenarios in which the robot should adhere to specific motion constraints imposed by the human's control interface. This approach to path planning gives special consideration to kinematic and dynamic constraints introduced to reconcile discrepancies between the control space of the user and the control space of the robot. The resulting paths more closely mirror paths produced by users of the same interface; which is helpful, for example, when inferring human intent or for control sharing. Our first insight is to develop a hierarchical finite state machine describing the constrained state space, state transitions and associated costs. We then use this definition to embed the constraints of the interface into our heuristic planning algorithm, named C*, with simple modifications to the A* D* family of graph search algorithms. This approach allows us to maintain powerful theoretical guarantees such as complexity and completeness. In this paper, we ground our augmented path planning algorithm with an implementation on a robotic wheelchair system and a Sip-and-Puff interface. We demonstrate that the new approach produces paths and control signals that more closely resemble user-generated data and can easily be incorporated into real hardware systems.
As assistive robotics has developed, various types of control interfaces have been explored. The modalities of these interfaces range from devices that provide a binary signal (such as a sip-and-puff) to speech recognition to a brain-computer interface (BCI) @cite_9 . Recent work in designing a HitL system that specializes in path planning under interface based constraints utilizes a sip-and-puff to allow for multiple inputs based on the state of the current interface. This was shown to be effective in assisting those with lower motor capabilities move around a room without requiring elaborate control over their wheelchair @cite_6 .