If the controlling actions (the reward) are negative it could negatively influence intrinsic motivation.
Culturally, intrinsically motivated acts that have no extrinsic reward are praised by society whereas actions that receive a tangible reward are not praised as highly, which would indicate that for actions that have a tangible reward they receive less praise and this undermines their intrinsic motivation to complete the task.