I don't think that society does feel that Andy. Some people do feel unfulfilled if they never marry, but society, in my experience, nowadays is not too bothered whether someone has a partner of not.
What society generally would see as wrong, in my experience of people's views, is the stipulation that to do the job of a priest, the person must be male and celibate. I have to say I agree with society on that one.