Agree with you about the drastic part. I prefer to operate cases with good enough evidence to perform the procedure not as a fishing expedition.
I would suggest more investigations like Doppler studies, Urine examinations and cultures, hemogram, blood sugars and only then trying to come to a diagnosis.
The problem seems like a chronic epididymitis
but investigations should help to come to a final diagnosis. A consultation with a Urologist
should be helpful.
Keep us posted.
Get well soon.