according to your description the possibility is bartholin cyst
because of blockade of the duct of the bartholin gland
, bartholin cyst occurs if it gets infected pus formation occurs called bartholin abscess
Now you have to consult local gynecologist and get examined once.
It can be treated by antibiotic and analgesic
therapy, if needed you can go for surgical option called marsupalization.