You could be having boils
To treat the same do warm water compresses twice in a day followed by application of topical antibiotic
cream. If its very tender, you may take an antiinflammatory analgesic
. Hopefully it should resolve in few days. If it persists or enlarges, a course of oral antibiotic may be required or some times incision and drainage
might also be required.
Hope that answers your query.