Experts say the weak economy has a lot to do with the latest drop in the annual U.S. birth rate, dampening enthusiasm for starting or adding to the family.