As you have varicocele
,you are thinking that it may affect your sexual drive.It is not true.Sexual activity will be normal in varicocele.
Pain can be due to varicocele.
Please get a Complete semen analysis
.If it is abnormal,then you have to go for surgery.
If it is normal,unless there is unbearable pain,surgery is not necessary.
You can manage with anti inflammatory drug
Wish you good health