Have you tried using nix on Gentoo? I’ve heard that this is the best of both worlds: you can use Gentoo to configure your system just so, and use nix for the big binaries, the unimportant userland stuff, and nix-shell.