Considering that the primary drive which motivates human behaviour is the ubiquitous drive to reproduce; does happiness to a significant extent depend upon how physically attractive you are? From personal experience it seems like this is indeed the case; but how can we make sense of a world in which the ultimate goal of life (happiness) can be dependent upon such a superficial thing as physical attractiveness?
I'm not sure that the goal of procreation trumps all others for human beings, so I can't accept your premise here. But I'm afraid that the world is in fact such that there are certain things that are beyond our powers that have an enormous impact on our "quality of life." I understand that it grinds against our need to feel in control, but I think a person who lives in abject poverty and can do next to nothing to help his or her family and friends, is more poorly positioned to lead a full life, than someone born in better circumstances. And if having friends is an important element of a good life, and I think it is , then being good looking is probably an asset. Of course, a person who relied on this quality too much might not develop sufficient depth to develop powerful relations but that is another issue.