Because currently, it seems like the only thing it’s recording are downvotes. Meanwhile upvotes are completely ignored, leading to pretty much every profile I see having a negative reputation.
Also, I have a very fragile ego and my -6 reputation hurts a bit.
Good news! At the moment, reputation points are strictly calculated based on live data. In other words, if you delete the downvoted content, the negative points disappear.