Fork is noisy sounds like metal parts are loose
So I was wrong about the loose part in the headset. Changing the front wheel fixed the problem.
I tried fixing the old wheel, and one bearing jumped out straight away as I opened the hub. I think that was the loose part.