The prompt is represented by a special token for each downstream task.