Sounds like Keratosis Pilaris
... otherwise known as "Chicken Skin." Here is a link with some options for treatment. There is no cure, but can be treated to help minimize them. I have this as well, I know how frustrating it can be and embarrassing at times too. I do know that personally they tend to fade somewhat during the summer if I spend enough time outside. I have them on my arms and legs. These are the 2 creams my doc suggested I use and I have used both.
Amlactin 12% Moisturizing Cream
5 Lotion, With Alpha Hydroxy Acid
for relief of Dry Skin