That's weird man. I was going to say wheel bearing, but if it goes away only when you take your foot off the pedal, I'm stumped.
I'd say it almost has to be something with your TB. It's really the only thing that is directly affected by the pedal. But then it would do it at idle too..........
This flat out doesn't make sense damn it. You're just trying to piss me off!!

If it doesn't do it when you're revving, that takes away the belts, the TB and your entire intake as a possibility.
So that leaves wheels/suspension. But it goes away after you let go of your pedal. So it's not your wheels or suspension, or your tranny, or anything that's rotating.
Do you have an automatic or manual. When you take your foot off the accelerator do you push in the clutch (manual)?