32-bit operating systems can support 4GB of memory (RAM and GPU combined) so that isn't the problem.
What kind of motherboard do you have? As it sounds as if you have an on board video card which may be getting its memory from your RAM. Please get back to us with more details.