Hi Daniel,
Welcome to HCM.
Read your problem,the description you have given looks like you have furnculitis which is caused by bacteria
staphylococcus. You need to take antibiotic other wise it may spread which will be associated with pain and have pus.Consult your surgeon to extract pus and for further management.
Wish you good health.