Is it a good idea to use BERT to answer a FAQ with semantic similarity?
Maybe the following article can help you:

FAQ Retrieval using Query-Question Similarity and BERT-Based Query-Answer Relevance (2019)

They evaluate their model in localgovFAQ and StackExchange datasets.