Yes this is infection of the root of hair due to vigorous manipulation or cleaning it is called furunculosis
You need to get an ENT consultation and take antibiotics and anti inflammatory medicines. You need antibiotics as the infection will not go on its own . the best antibiotics are quinolones like ciprofloxacin
but discuss with your doctor before taking any.
If not treated there can be pus formation .
If you have diabetes
then be careful and take early treatment.
Do not try to press or check it again and again by yourself