Do you have network monitoring software to make sure that your connection isn't fully being utilized during the high ping times? Ping traffic is ICMP packets, and they have the lowest priority out of all the other traffic, and if the circuit is 100% utilized, then the pings will be very slow like that.