Hi, Welcome to HCM, I am Dr. Das
From your history it is evident that you have primary infertility
. Now, you did not mention the amount of pus cells that were found in your sperm. If it is also increased then it is definitely an infection. Just consult your home physician to have a course of antibiotic.