<p dir="auto">In this run:<br>
<a href="http://kubekins.dls.corp.google.com:8080/view/Scalability/job/kubernetes-e2e-gke-large-cluster/51/console" rel="nofollow">http://kubekins.dls.corp.google.com:8080/view/Scalability/job/kubernetes-e2e-gke-large-cluster/51/console</a></p>
<p dir="auto">131 tests failed.<br>
However, most of them (all but two) failed with the following error:</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="01:40:47   Expected error:
01:40:47       &lt;*errors.errorString | 0xc8200d80d0&gt;: {
01:40:47           s: &quot;timed out waiting for the condition&quot;,
01:40:47       }
01:40:47       timed out waiting for the condition
01:40:47   not to have occurred
01:40:47 
01:40:47   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:190"><pre class="notranslate"><code class="notranslate">01:40:47   Expected error:
01:40:47       &lt;*errors.errorString | 0xc8200d80d0&gt;: {
01:40:47           s: "timed out waiting for the condition",
01:40:47       }
01:40:47       timed out waiting for the condition
01:40:47   not to have occurred
01:40:47 
01:40:47   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:190
</code></pre></div>
<p dir="auto">which means that we couldn't create a namespace.</p>
<p dir="auto">However, I looked into logs of apiserver and there are not even such requests in apiserver.</p>
<p dir="auto">In gke-large-cluster suite, two tests failed for me with the following error:<br>
"Unable to connect to the server: x509: certificate signed by unknown authority"</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="01:39:45   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubeproxy.go:107
01:39:45 
01:39:45   Expected error:
01:39:45       &lt;*errors.errorString | 0xc8211d8480&gt;: {
01:39:45           s: &quot;Error running &amp;{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://8.35.199.16 --kubeconfig=/workspace/.kube/config exec --namespace=e2e-tests-e2e-kubeproxy-rew7e host-test-container-pod -- /bin/sh -c for i in $(seq 1 5); do echo 'hostName' | timeout -t 3 nc -w 1 -u 10.38.215.4 8081; echo; sleep 1s; done | grep -v '^\\s*$' |sort | uniq -c | wc -l] []  &lt;nil&gt; Please enter Username: Please enter Password:  Unable to connect to the server: x509: certificate signed by unknown authority\n [] &lt;nil&gt; 0xc82358a460 exit status 1 &lt;nil&gt; true [0xc820dd1790 0xc820dd17a8 0xc820dd17c0] [0xc820dd1790 0xc820dd17a8 0xc820dd17c0] [0xc820dd17a0 0xc820dd17b8] [0xa7bfc0 0xa7bfc0] 0xc820ffafc0}:\nCommand stdout:\nPlease enter Username: Please enter Password: \nstderr:\nUnable to connect to the server: x509: certificate signed by unknown authority\n\nerror:\nexit status 1\n&quot;,
01:39:45       }
01:39:45       Error running &amp;{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://8.35.199.16 --kubeconfig=/workspace/.kube/config exec --namespace=e2e-tests-e2e-kubeproxy-rew7e host-test-container-pod -- /bin/sh -c for i in $(seq 1 5); do echo 'hostName' | timeout -t 3 nc -w 1 -u 10.38.215.4 8081; echo; sleep 1s; done | grep -v '^\s*$' |sort | uniq -c | wc -l] []  &lt;nil&gt; Please enter Username: Please enter Password:  Unable to connect to the server: x509: certificate signed by unknown authority
01:39:45        [] &lt;nil&gt; 0xc82358a460 exit status 1 &lt;nil&gt; true [0xc820dd1790 0xc820dd17a8 0xc820dd17c0] [0xc820dd1790 0xc820dd17a8 0xc820dd17c0] [0xc820dd17a0 0xc820dd17b8] [0xa7bfc0 0xa7bfc0] 0xc820ffafc0}:
01:39:45       Command stdout:
01:39:45       Please enter Username: Please enter Password: 
01:39:45       stderr:
01:39:45       Unable to connect to the server: x509: certificate signed by unknown authority
01:39:45       
01:39:45       error:
01:39:45       exit status 1
01:39:45       
01:39:45   not to have occurred
01:39:45 
01:39:45   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:3449"><pre class="notranslate"><code class="notranslate">01:39:45   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubeproxy.go:107
01:39:45 
01:39:45   Expected error:
01:39:45       &lt;*errors.errorString | 0xc8211d8480&gt;: {
01:39:45           s: "Error running &amp;{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://8.35.199.16 --kubeconfig=/workspace/.kube/config exec --namespace=e2e-tests-e2e-kubeproxy-rew7e host-test-container-pod -- /bin/sh -c for i in $(seq 1 5); do echo 'hostName' | timeout -t 3 nc -w 1 -u 10.38.215.4 8081; echo; sleep 1s; done | grep -v '^\\s*$' |sort | uniq -c | wc -l] []  &lt;nil&gt; Please enter Username: Please enter Password:  Unable to connect to the server: x509: certificate signed by unknown authority\n [] &lt;nil&gt; 0xc82358a460 exit status 1 &lt;nil&gt; true [0xc820dd1790 0xc820dd17a8 0xc820dd17c0] [0xc820dd1790 0xc820dd17a8 0xc820dd17c0] [0xc820dd17a0 0xc820dd17b8] [0xa7bfc0 0xa7bfc0] 0xc820ffafc0}:\nCommand stdout:\nPlease enter Username: Please enter Password: \nstderr:\nUnable to connect to the server: x509: certificate signed by unknown authority\n\nerror:\nexit status 1\n",
01:39:45       }
01:39:45       Error running &amp;{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://8.35.199.16 --kubeconfig=/workspace/.kube/config exec --namespace=e2e-tests-e2e-kubeproxy-rew7e host-test-container-pod -- /bin/sh -c for i in $(seq 1 5); do echo 'hostName' | timeout -t 3 nc -w 1 -u 10.38.215.4 8081; echo; sleep 1s; done | grep -v '^\s*$' |sort | uniq -c | wc -l] []  &lt;nil&gt; Please enter Username: Please enter Password:  Unable to connect to the server: x509: certificate signed by unknown authority
01:39:45        [] &lt;nil&gt; 0xc82358a460 exit status 1 &lt;nil&gt; true [0xc820dd1790 0xc820dd17a8 0xc820dd17c0] [0xc820dd1790 0xc820dd17a8 0xc820dd17c0] [0xc820dd17a0 0xc820dd17b8] [0xa7bfc0 0xa7bfc0] 0xc820ffafc0}:
01:39:45       Command stdout:
01:39:45       Please enter Username: Please enter Password: 
01:39:45       stderr:
01:39:45       Unable to connect to the server: x509: certificate signed by unknown authority
01:39:45       
01:39:45       error:
01:39:45       exit status 1
01:39:45       
01:39:45   not to have occurred
01:39:45 
01:39:45   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:3449
</code></pre></div>
<p dir="auto">Those errors come from:<br>
<a href="http://kubekins.dls.corp.google.com:8080/view/Scalability/job/kubernetes-e2e-gke-large-cluster/51/console" rel="nofollow">http://kubekins.dls.corp.google.com:8080/view/Scalability/job/kubernetes-e2e-gke-large-cluster/51/console</a></p>
<p dir="auto"><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zmerlynn/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zmerlynn">@zmerlynn</a></p>