PuTTY : a free ssh client for Windows.

This client is capable of ssh2 and does not require an installation. Everything you need is contained in this executable.
PuTTY v0.58

Other interesting PuTTY tools:
pagent so you don't have to type your public key password.
puttygen for creating keypairs for your connections.
pscp a command line scp program.
psftp a command line sftp program.
plink for setting up batch tunnels.
zip file containing the entire putty collection.
md5sums from the manufacturer, since you can't trust me.

Here is some helpful documentation on utilizing PuTTY's public key generator and agent capabilities.


WinSCP : a free scp client for Windows.

This is a pretty nifty self contained graphical scp program. It is sort of like ftp, but does not send your clear text password over the network. Just download it, install it, and delete your ftp program.
WinSCP v3.7.1