Infertility is not always just a man's problem. Both men and women can have problems that cause infertility. Nearly 15% of couples have problems trying to have a baby.