Taking anesthetics would help you relieve pain as long as the drug is in your body later on again it may have same problem. As this is a anatomical(physical) problem physiotherapy
will help you. Some more tips like:
Wearing cotton underwear.
Neem oil is a good topical treatment for irritation.
diet may help.
If the pain still persists then meet a consultant which may end up with analgesics and later on if necessary may be surgery.
Thanks, Have a good health.