As you said, there are chances of hereditary factors being in here as it is present in your brother and mother as well.
Please get your Growth Hormone
(GH) assayed. There may be an endocrine abnormality in you. Marfan syndrome
is also one of the possibilities.
Meanwhile, eat healthy. Do not skip meals.
I wish you good health.