The short history you have given does point to allergy to milk. You could try stopping his feed and giving him a milk substitute formula like soy milk formula, amino acid
formula, and gauge his condition. Also, milk allergy
can be controlled with homoeopathy. You can consult a good homoeopath so that he doesn't have to suffer from this allergy throughout his life.
All the best!