For a very gentle rust removing cleaner, I've had very good success with "Pre-Lim" from the people that make "Renaissance" conservators wax.
http://www.picreator.co.uk/articles/4_pre_lim_surface_clea.htm
I got it for cleaning the old case hardening surfaces on my EJ Churchill side lock, and now use it on all my good guns.