FLUSH LOGS command introduces a long sleep
There was issue with the log-error file to which I was suppose to log mysql errors.
I had this line in my.cnf

log-error=/var/lib/mysqld.log


Due to permission issue mysql was not able to create this log file nor an error was thrown suggesting the same.

I selectively removed and toggled the settings which helped me reach to the problem.