Thanks for your query.Based on the facts that you have posted it appears that you have what is called as Fordeyce's spots on penis.
The penile skin is rich in sebaceous glands and hence prone to get more small sebaceous cyst
due to accumulation of sebum beneath the skin.(Fordeyce's spots)
Normally they fade away without treatment however they need to be treated if increase in size or get infected.
Do not worry they will get resolved over a period of time without any treatment.