I'm not sure I understand the question - do you mean am I pinging from my computer to my VPS, or am I pinging using Putty to the other sites?
I've just been pinging using a DOS prompt in windows, and tracerouting using PingPlotter.
Here's the same sites pinged from my VPS:
host avg ping traces through ping from putty
Eyedea - Creative Design, Web Development & Software - IDEAS THAT WORK 50ms Vocus 2.7ms
netvantage.com.au 55ms Vocus 8ms
corporateinteractive.com.au 36ms optus 1.6ms
digitalpacific.com.au 38ms sisgroup/alter.net 3.2ms
anchor.com.au 50ms Vocus 2.4ms
Website Managers - make the internet work for you! 38ms sisgroup/alter.net 2.9ms
tpg.com.au 37ms tpgi (?) 4.2ms
magikhosting.com.au 43ms vocus/alter.net 1.2ms
neubreed.com.au 36ms sisgroup/alter.net 1.6ms
crucial.com.au 52ms asianetcom 0.5ms
Doesn't seem to be any pattern there...
Also the slower pings seem to be not isolated to my VPS, crucial.com.au and 203.98.88.34 are running at 50ms instead of 35ms too.
I'd expect 50-60ms if I was pinging Melbourne or Brisbane - there's no chance things are being routed elsewhere or something? (Pardon my insane level of ignorance...) :-)