Some men are very sensitive to stress and it affects them sexually, particularly financial stress, if they derive a good part of their self-esteem from being a good provider (kind of like how a woman who gains self-esteem from body image would feel if she were obese).