According to your description it seems like a boil. Repeated boils
may be an indicator of decreased immunity. You may check your blood sugar to begin with. Benzoyl peroxide
may need to be supplanted with local antibiotics. There are similar conditions like herpes
which need to be excluded. You can contact your physician for local examination and needful tests.