The men of my dad's family run short and stocky. My father is 5'8", his brother and my brother are both 5'4"/5'5", my uncle's son is just slightly taller. His sister's kids (both dudes) aren't stocky but they're not very tall, either.
But even though they should go kill themselves, my five-eight father has been married to my (6'0"!) mother for 29 years, and if you ask her she thought he was super handsome and funny. My uncle was married to his wife for I think over 40 when she died last fall, and I have to assume they were together for a lot of the same reasons. My brother's about to get married this year and they've been together for I think two years now despite him being stationed overseas.
It's almost like your height doesn't matter, but you need a good personality and be willing to put effort into your relationship or something...
(edit: can't fucking write today, jeez.)