Sound like a USB controller issue, it's trying to save power I would guess. It's the USB Root Hub in your system settings I think. Also check your Power Options, could be you've got something in there that needs tweaking.
If you look online any of the standard audio system optimization guides should be able to get to it right.
You might check your sound card manufacturer website for clues too.