Ok so I have a headset and an USB, if I have my USB in the PC while I also have my headset turned on, my headset makes weird sounds (similar to the bee sound, don't know how to say it in english really).

~USB doesn't cause that sound on speakers.
~When I take the USB out, the noise stops.
~Higher the sound on headset is set to, louder the noise is.