Wholly recommend going back to it, even if at a lower difficulty. Shivering Isles was a great dlc and imo better than the base game. Main issue with Oblivion was that the levelling was really messed up, similar to Morrowind but without the transparency and with many more issues with enemy-scaling. Keeping a low level means you can enjoy the story without having to deal with the levelling system issues as much