It might have due to breaking of hair folicele or due to some thing bite causing infection on labia minora
There may be cyst
on the part.
Keep the part clean and take antibiotic if pain and swelling is there,take some anti histamines
If there is no improvement,take gynaec opinion.
ok and bye.