Libertarians don’t see it in those terms. Wealth doesn’t belong to society, and therefore there’s no implication that all members of society are entitled to it. Not having any wealth sucks and so does having to do onerous work in order to survive, but it’s easy to imagine how if you were rich, you wouldn’t want your money taken away and given to the poor, and so it’s hard to fault the rich for feeling that way too.