Suchir Balaji:
"To believe that empirical progress made consistently in the past will continue is a bad way of making predictions about AGI. 
...not only will you run out of data well before GPT-7, but even GPT-1000 would still lack important capabilities due to the fundamental limitations of transformers and autoregressive modeling."