I was told a long time ago by my doctor, I was getting eczema on my hands, and he told me not to use soap and went further on to explain that soaps and washes strip the protective layer of oil off your body and actually increase the risk of skin problems and gives a foothold to the odour producing bacteria, not to mention drying your skin out.
I havent used soap or any kind of wash for 15 years unless i'm covered with say grease or dirt. Never had a problem with a smell. I even stopped using deodorant for while, which works as long as your diet is fairly healthy and doesnt vary too much.
I use moisturiser when required.
I read somewhere recently, I should track this down, that we generally shower too much and that also effects our skin negatively, I think it should be under 7 a week.
That said, I always shower after a workout, but always no soap.