Detecting grammatical errors with BERT
Absolutely, you could use bert pre trained model to suggest corrected sentences without annotated data as long as you are using a pre trained model. Here is a good repo that shows it
https://github.com/sunilchomal/GECwBERT
Hope it helps