title: Is there a limit to pd.to_gbq() loading to bigquery() from pandas?
body: <p>I have a dataframe that has about 4 million rows and 18 columns. I am trying to push to a Google Big Query Table using <strong>pd.to_gbq().</strong> </p>
  
  <p>What I see as the end result in Google BigQuery is 2.29 million rows..</p>
  
  <p>I think this may be related to the streaming buffer.. but shouldn't the details of what is loaded be accurate? </p>
  
  <p>I have already checked the pandas documentation with regards to loading to Google Big query and I see no limits posted there. </p>
  
  <p>Here are some test results:
  <a href="https://i.stack.imgur.com/xGpZF.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/xGpZF.png" alt="enter image description here"></a></p>
  
  <p>Here is the code and the shape of the dataframe when I load it:
  <a href="https://i.stack.imgur.com/GFL2u.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/GFL2u.png" alt="enter image description here"></a></p>
  
  <p>Can anyone confirm whether or not this is due to the streaming buffer? And that the actual size will be updated? Or is this an issue with pd.to_gbq() itself? </p>
  
  <p>Thanks!</p>