has been assigned to pregnancy
category C by the FDA. Some animal studies using high doses have revealed evidence of embryotoxicity. There are no controlled data in human pregnancy. Propranolol has been given during pregnancy to treat both maternal and fetal conditions without evidence of teratogenicity. However, fetal and neonatal adverse effects are reported and should be monitored. Propranolol should only be given during pregnancy when benefit outweighs risk.
You are worrying unnecessarily regarding the damage to your child as chances of this happening is as good as rare.
Doctor is adopting a safety route and that's why he has stopped propranolol in you.
There is lot of information regarding this on Internet and you can go through that so that you can get mental comfort from it.