Welcome to HCM,
From your history it seems that you might be having,
1, Forming abscess
due to hair follicle infection
Consult surgeon and rule out fistula-in-ano.
If forming abscess is there, one course of antibiotic and anti-inflammatory medicines you will be alright.
You can take hot water tub bath with some antiseptic lotion.
Ok and bye.