To remove rust, slice a fresh potato in half and cover the cut end in baking soda (or liquid dish detergent).
Rub the rust spots away with the potato. If the potato end gets slick, slice it off, dab on some more baking soda, and scrub a bit more until the rust is gone.