Bigquery streaming API timeout error
Question: We're using bigquery streaming API. All went well until recently (no code
change) - In the last few hours we get many errors like:

> "The API call urlfetch.Fetch() took too long to respond and was cancelled.
> Traceback (most recent call last): File "/base/data/home/runtimes/python27"

or

> "Deadline exceeded while waiting for HTTP response from URL"

The insert call is done on a python deferred process and is retried again
after a wait.

Questions:

  * How can we check if it's our internal issue or a general problem with big query?
  * Can we increase the 5000 timeout?


Answer: Are you running in appengine? If so, you can do this:

    
    
    from google.appengine.api import urlfetch
    urlfetch.set_default_fetch_deadline(60)
    

That said, streaming ingestion shouldn't be anywhere close to the default 5
second error. There was a networking configuration issue with streaming
ingestion, it should be resolved now.

Are you still seeing the issues?

