It's probably because that video card has a built in sound chip for HDMI.
What you need to do is change your default sound device. (on XP) Go to Control Panel> Sounds and Audio Devices> Audio> then select the default device under Playback.
You may also have to change your sound devices in Ventrilo setup as well.
Try that.