My opinion on the quote.
"What's the most important thing in this world? What's the one thing a guy would walk hundreds of miles just to get back ?" - Luke
I don't thing I completely agree that it's family. In normal world, yes. But in that apocalypse, I'm pretty sure it's safety. Just look - all of the groups sooner or later move in search of safety/more safety.