Even if someone does find themselves wondering whether your husband might be wearing women's underwear, they are unlikely to confront him with such a suggestion - to do so would make for an awkward and embarrassing situation for all concerned, particularly if their suspicions turned out to be unfounded!