It’s dumb, but sometimes windows refuses to acknowledge that audio can work if you don’t have an audio device currently “active”.

On my old computer I just plugged a headphone extender into the back and that fixed it, since it saw there was a connected audio device, even though there weren’t even headphones attached.

I’m sure there was a better fix, but a cable on the back wasn’t really bothersome.