I noticed some extra noise from the strings ringing out, even when I manually muted the strings. A bit of investigation and it turned out to be the head part of the guitar.
Originally I used a headband to mute the strings but it looks a bit silly. Then I found this, which I now use all the time.
It's really useful when recording to keep the noise away.