Welcome to health care magic forum,
will affect adversely to baby. so discuss with your husband frankly about future of baby. avoid conflicts. if possible then go to other place from your husbands house like to your parents or brother or close relative who can understand your problem.
have a good health