The testis is connected to the abdomen through spermatic cord
The cord is surrounded with muscles which start from abdominal wall.
So,if the muscles contract,they will pull the testis up.The position of the testis also depends on the temperature.
So,unless it is enlarged and painful,nothing to worry.
You are experiencing natural phenomenon.
Wish you good health