In my view it is purely because priests at some point were expected to be celibate. Some were happy to be so - but what about the others? Instincts and desires have to go somewhere. And in modern psychological parlance repression causes a Reaction Formation.
http://en.wikipedia.org/wiki/Reaction_formation