A poor diet also can cause gynecomastia in some men.