Noticeably, despite being both based on and integrated into a BERT$_\text{base}$ model, our architecture even outperforms a standalone BERT$_\text{large}$ model by a large margin. 
 Question: What models other than standalone BERT is new model compared to?
Only Bert base and Bert large are compared to proposed approach.