Thanks for query,
Sex has no relation to physical built up.
Sex is in our mind & not in body or organ.
may leads to less arousal of our parasympathetic system cause you less arousal or poor performance.
Leave all worries,Do some meditation
You have no disease.
You will be all right.