Thanks for your query.Based on the facts that you have posted it appears that you have what is called as Sebaceous cyst
over shaft of the penis.
Penile skin is rich in sebaceous glands and hence prone to get more sebaceous cyst due to accumulation of sebum beneath the skin.
Normally they fade away without treatment however they need to be treated if increase in size or get infected.
Please consult qualified General Surgeon
for clinical evaluation and further treatment.
If needed some of them which are bigger may need to get excised in Toto (Completely along with the sac)