You should not need drivers to connect to the net. But whatever.
Wireless is a known issue with Ubuntu. It has been discussed on and off since the release of Gutsy.
Gutsy Gibbon and Really Slow Internet — The NeoSmart Files
Your best bet is to hit up the Ubuntu Forums and see if they have any workarounds for it. They would know best.