Problem connecting to Arduino with USB and audio
Solution was to add an isolation transformer. Readily available on eBay with 3.5mm jacks, so I have just added one inline.
https://www.ebay.co.uk/itm/274391739005