Get long answers from BERT
You can check quora for your QnA dataset.

As far as long answers are concerned it may not be because of BERT as  SQuADhas very crisp and short answers for most of its questions.

BERT already does understand long term dependencies in your data(one of reasons for using deeply bidirectional tranformer).