To me this is Jesus himself giving approval of celibacy but he qualifies it by saying, "let anyone accept this who can" i.e., a man who is called to the priesthood.

It certainly doesn't follow Jesus meant the priesthood. We have no idea if Jesus was celibate, he could have been married for all anyone knows. Nowhere in the Gospels does it state he wasn't married. Some tradition think he was and had kids too!