this means the switch wich is the closest to the modem has to do a lot of work..
this means everything is probably slowed down a little.
you can buy a fast router, as fast as possible, and connect each switch to a seperate port on your router
But, what's the speed of your internet connection?