Every woman has a certain number of follicles in the ovaries that mature into ova, one in each cycle usually, throughout the reproductive life. No new follicles are manufactured in the ovaries and this means, with each passing year the number of follicles is getting less and thereby, the chances of conception. You are in the ideal time to plan for a pregnancy
as far as your age is concerned. I think you should take your doctor's advice. People can get pregnant even in late forties, but chances get grim every year. Take care.