As you may know, every human being gets a unique set of 23 pairs of chromosomes at conception. These fall into two categories. One pair of chromosomes determines sex--the XX combination means you become female, the XY combination means you become male.
The other 22 pairs, the non-sex chromosomes (they're called autosomes), supply what we might call the standard equipment that all humans get. These 22 pairs constitute an all-purpose genetic blueprint that in effect is programmed for either maleness or femaleness by the sex chromosomes. The programming is done by the hormones secreted by the sex glands.
For example, the autosomes give you a voice box, while the sex hormones determine whether it's going to be a deep male voice or a high female voice. Similarly, the autosomes give you nipples, and the sex hormones determine whether said nipples are going to be functioning (in females) or not (in males).