It's more complicated than all that. The first impression could be that there is a Mithocondrial Eve and a Y chromosome Adam...
But let's think as an example of Pitcairn's Island, the one were the Bounty mutinies ended. (The story, briefly, is as follows:
there is a mutiny in the Bounty, led by Christian Fletcher against captain Bligh. The mutinies flee, take women from some island and end at Pitcairn. All the inhabitants are descendants from the ship's sailors and the captured women)
Today all of them have the same surname: Fletcher. Does this mean Fletcher was the only father? No, let's see what happened:
To the island came sailors with diferent surnames and all of them were fathers of their children. With the passage of time a surname produced only daughters and disappeared.
Then another one produced only daughters and disappeared too...
That repeated several times resulted in all of them being called Fletcher. That's their name and implies that they are his descendants in some way, but through a complicated path which doesn't mean that the others have not left descendants or that their gene pool has been lost. The surname is lost, not the genes.
Fletcher doesn't have anything special.
Translated into genetics: if a man has only daughters, his Y chromosome is lost, if a woman has only sons, her mitochondrial DNA is lost.
with time, this results in a single mitochondrial Eve and a single Y chromosome Adam, given that the original population is small. It seems to be the case that mankind consisted in an undetermined time in the past, after a loss of population (maybe some 150 000 years ago) of only 10 000 - 100 000 people, which allowed the apparition of these characters (Mit. Evea and YCA) but that doesn't mean they have something special.