geco,
I may be entirely wrong, but I think to answer your question, if you record your ammo on the "customs" forms when you leave the US, and bring the unused ammo and possibly the "spent cases" back, you should be allowed to return with it.
Mike