I had no problems with erections even when I had no sex hormones at all. On HRT I also have no problems and my libido is no lower than that of girls, so there are no problems with sex life.
But even if HRT threatened my potency, I would have resorted to it without a doubt. Sex is not important to me, and it would be crazy for me to trade beauty for the ability to do it. Ruining your life and youth to jerk off alone and mentally ill. You can see the result of this decision from the posts of this couple.