From what I’ve learned, there is a difference when used as an actual apology.

“I’m sorry” (on its own, without being followed by “you feel that way”) is genuine and tells that the speaker is honestly so.

“I apologize” is formal and kind of fake. They’re likely more sorry they were called out rather than sorry for what they were called out for.

This is a Demetri Martin joke