My Byrdland does does the same thing --- though just a tiny bit.
I took a small piece of black wet/dry 1500 grit sandpaper, folded it over a few times and forced it between the pickup ring and the pickup. You can't see it, it fits snug and the vibrations stopped.
Granted, the vibrations were only heard acoustically --- not through an amp.