title: proxysql SHUNNED servers in hostgroup
body: <p>I have 2 proxysql(2.0.13) + keepalived in front of a 3-node galera-cluster, and 2 of the galera-nodes appeaers as &quot;SHUNNED&quot; in my hostgroup 10.
  I do not know why they appear as &quot;SHUNNED&quot; and they are never recovered.</p>
  <p>So i was hoping that somebody here can help me bring the shunned servers back in the loop.</p>
  <p>What i've tried:
  - Set the var mysql-shun_on_failures = 5000 &amp; mysql-shun_recovery_time_sec = 10
  - reboot the proxysql nodes</p>
  <p>I have made connections to the hostgroup 10, and did some queries, to trigger a recovery, but they are still shunned.</p>
  <p>Here's some info from proxysql</p>
  <pre><code>Servers:
  Admin&gt; select * from runtime_mysql_servers;
  +--------------+-----------+------+-----------+---------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
  | hostgroup_id | hostname  | port | gtid_port | status  | weight | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment |
  +--------------+-----------+------+-----------+---------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
  | 10           | 10.4.4.21 | 3306 | 0         | SHUNNED | 1      | 0           | 1000            | 0                   | 0       | 0              |         |
  | 20           | 10.4.4.21 | 3306 | 0         | ONLINE  | 1      | 0           | 1000            | 0                   | 0       | 0              |         |
  | 20           | 10.4.4.22 | 3306 | 0         | ONLINE  | 1      | 0           | 1000            | 0                   | 0       | 0              |         |
  | 30           | 10.4.4.23 | 3306 | 0         | ONLINE  | 1      | 0           | 1000            | 0                   | 0       | 0              |         |
  | 30           | 10.4.4.22 | 3306 | 0         | ONLINE  | 1      | 0           | 1000            | 0                   | 0       | 0              |         |
  | 30           | 10.4.4.21 | 3306 | 0         | ONLINE  | 1      | 0           | 1000            | 0                   | 0       | 0              |         |
  | 10           | 10.4.4.23 | 3306 | 0         | ONLINE  | 1      | 0           | 1000            | 0                   | 0       | 0              |         |
  | 10           | 10.4.4.22 | 3306 | 0         | SHUNNED | 1      | 0           | 1000            | 0                   | 0       | 0              |         |
  +--------------+-----------+------+-----------+---------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
  
  
  Hostgroups:
  Admin&gt; select * from runtime_mysql_galera_hostgroups;
  +------------------+-------------------------+------------------+-------------------+--------+-------------+-----------------------+-------------------------+--------------------+
  | writer_hostgroup | backup_writer_hostgroup | reader_hostgroup | offline_hostgroup | active | max_writers | writer_is_also_reader | max_transactions_behind | comment            |
  +------------------+-------------------------+------------------+-------------------+--------+-------------+-----------------------+-------------------------+--------------------+
  | 10               | 20                      | 30               | 9999              | 1      | 1           | 1                     | 30                      | galera-hostgroup-1 |
  +------------------+-------------------------+------------------+-------------------+--------+-------------+-----------------------+-------------------------+--------------------+
  
  Status:
  Admin&gt; select hostgroup,srv_host,status,ConnUsed,MaxConnUsed,Queries,Latency_us from stats.stats_mysql_connection_pool order by srv_host;
  +-----------+-----------+---------+----------+-------------+---------+------------+
  | hostgroup | srv_host  | status  | ConnUsed | MaxConnUsed | Queries | Latency_us |
  +-----------+-----------+---------+----------+-------------+---------+------------+
  | 10        | 10.4.4.21 | SHUNNED | 0        | 0           | 0       | 289        |
  | 30        | 10.4.4.21 | ONLINE  | 0        | 0           | 0       | 289        |
  | 20        | 10.4.4.21 | ONLINE  | 0        | 0           | 0       | 289        |
  | 10        | 10.4.4.22 | SHUNNED | 0        | 0           | 0       | 281        |
  | 30        | 10.4.4.22 | ONLINE  | 0        | 0           | 0       | 281        |
  | 20        | 10.4.4.22 | ONLINE  | 0        | 0           | 0       | 281        |
  | 10        | 10.4.4.23 | ONLINE  | 1        | 1           | 106     | 277        |
  | 30        | 10.4.4.23 | ONLINE  | 0        | 0           | 0       | 277        |
  +-----------+-----------+---------+----------+-------------+---------+------------+
  
  My ping-log:
  Admin&gt; select * from monitor.mysql_server_ping_log order by time_start_us DESC limit 0,10;
  +-----------+------+------------------+----------------------+------------+
  | hostname  | port | time_start_us    | ping_success_time_us | ping_error |
  +-----------+------+------------------+----------------------+------------+
  | 10.4.4.23 | 3306 | 1597916943398296 | 257                  | NULL       |
  | 10.4.4.21 | 3306 | 1597916943298413 | 232                  | NULL       |
  | 10.4.4.22 | 3306 | 1597916943198499 | 276                  | NULL       |
  | 10.4.4.22 | 3306 | 1597916935355114 | 220                  | NULL       |
  | 10.4.4.23 | 3306 | 1597916935277079 | 259                  | NULL       |
  | 10.4.4.21 | 3306 | 1597916935199034 | 232                  | NULL       |
  | 10.4.4.22 | 3306 | 1597916927359456 | 175                  | NULL       |
  | 10.4.4.21 | 3306 | 1597916927278902 | 242                  | NULL       |
  | 10.4.4.23 | 3306 | 1597916927198335 | 302                  | NULL       |
  | 10.4.4.21 | 3306 | 1597916919324515 | 189                  | NULL       |
  +-----------+------+------------------+----------------------+------------+
  </code></pre>
  <p>Thank you all..</p>