I’m a man and I still use “just” because even if a man doesn’t use it I see them as aggressive and dickish. I feel it’s just more polite to use it.