Yes, close unused inputs like line-in, mic etc.
Are you saying you have tried a regular wired mouse with same problems? Then I would direct my attention to your video card. Try spacing the video card farther away from the soundcard. If you have open slots to do that.