The testis is suspended by spermatic cord
and during development it comes to the scrotum
Its growth has no relation to milk.
They are sensitive organs.So,gentle touch can lead to pain.It is natural.
If you have any doubt regarding testicles,get a Colour doppler of scrotum.
Wish you good health