Thanks for the query.
According to your description that could be bartholin abscess
As you are getting recurrent abscess:
-Consult gynecologist once
-Get examined, take antibiotics
-Go for marsupalisation
-Check for blood sugar levels once
That can possibly give permanent cure.
For more details you can ask me through: http://www.healthcaremagic.com/doctors/dr-sree-gouri-sr/63429