The sweep whine would be expected with that design. It does almost nothing to prevent it. This might be deliberate, but I don't know why you'd want it to do that. Maybe I'm just not punk enough!
If you have a 9v battery snap to 2.1mm DC adapter, try powering it with a battery that way and see what happens to the noise.