Joules is unfortunately a vector because it’s over a distance in a direction.

What? Joule is an energy unit and energy is a scalar quantity and not a vector. There is no “energy direction” and no “distance”.

Edit: even your edit doesn’t make sense. Provide a source that says that energy or joule is somehow a vector.