Gmail Recording in Chrome
Have you considered seeing if an extension has access to your microphone on Google Apps? If it's not a clean install of chrome and you've previously installed chrome extensions the microphone may be in use by one of these extensions. 

The only other thing I could think of is if you have a Google Voice or Hangouts conversation open that you are unaware of... but I highly doubt this would be the case with your issue.