[wlug] SSH Password-Guessing Attacks

I suppose you know that if you put a machine on the Internet with an SSH server listening on port 22, you are going to get bombarded with password-guessing login attempts. Previously, I thought that moving the SSH server to a nonstandard port was sufficient to block these. But now I am seeing these attacks happening on my Rimu VPS anyway. Should I bother to change the port again?