Actually, another possibility is the server you're joining. Does your problem occur with more than just 1 server?
If it's just one server you're lagging on, then blame the server, not you.
But if...