Hi there ~
Regularly use a mild soap which retains your moisture but takes away the oil and also use retinoic acid
based gels on the ones that are not going away. It might also be in your favor to use oral doxycycline for a period of 15 - 20 days. However please also see a dermatologist
to get the correct picture of what is exactly going on and what else can make life better for you since on a public forum there is very limited scope to seeing really what the problem is. I hope this helps.
Take care and have a lovely day !