Hi, I can understand your concern for folliculitis after applying oral and topical creams for keratosis pilaris. It can be due to secondary infection or spreading of the infection in the hair roots due to occlusion by moisturizing cream. The only precaution you must follow is not to touch, pinch pop or squeeze any of them other wise it can get infected and can cause complications. If I were your treating dermatologist then would have suggested you to apply plain antibacterial cream such as fusidic acid or mupirocin (latest is retapamulin) and to take pain killer tablet by mouth for reducing the intensity of pain and redness. You can additionally take antihistamine benadryl or loratadine by mouth. Get yourself immunized for tetanus if not done in last 1 year period. Take care.