Hello and welcome to HCM.
Thank you for your query.
First of all, let me explain to you, the cause for occurrence of pus filled bumps in or around the vaginal lips. This is most commonly a sign of some infection in the body, and at times even due to allergies,
folliculitis, in-grown hair, cysts or certain deficiencies.
Treatment will depend entirely on the diagnosis, but in my opinion you could try sitting in warm-baths for about 15 minutes, 3-4 times a day, this should provide relief in many cases. Either way, you will have to visit a doctor and seek the required medical treatment.
Do not worry about this, as in most cases, it is harmless and can easily be treated.
I hope I have succeeded in providing the information you were looking for. Please feel free to write back to me for any further clarifications. I would gladly help you.
Best wishes.