Our second approach incorporates shallow syntactic information in downstream tasks via token-level chunk label embeddings. Task training (and test) data is automatically chunked, and chunk boundary information is passed into the task model via BIOUL encoding of the labels. We add randomly initialized chunk label embeddings to task-specific input encoders, which are then fine-tuned for task-specific objectives. 
 Question: Which syntactic features are obtained automatically on downstream task data?
token-level chunk label embeddings  chunk boundary information is passed into the task model via BIOUL encoding of the labels