The $55 billion + is a waste product produced by his lifelong love of mathematics. Seriously. Even Buffett would probably agree that there’s a societal problem where a single human can amass that amount of (unnecessary) wealth. Probably explains why he gives it away. For him the satisfaction is seeing his system win - not necessarily the dividends it collects.
Don’t spend much time being ashamed of your former self, instead, be proud of your current self.