well not really... technically if your in VIC and your picking NSW servers to test your speed then it will determine the outcome of your ping results and download speeds
Your modem, your cabling, electrical interference, phone line, exchange distance (cable distance not physical), ISP hardware at the exchange, if your dog barks while its steaked into the front yard using a large steel steak which in turn is spiked through the phone line and shocks the dog and thats why its barking everytime you drop out and so on.