I do it.
I suspect lots of people do.
Sometimes an annoyance (or something bigger) and it is hard to let it go. Truth is that kind of grudge-holding, meat grinding holding on to things only hurts yourself. It doesn’t do a thing to the person who hurt you for you to lay there loosing sleep over what happened.
Act appropriately, set boundaries, do the right thing as best as you can, then let it go and let them deal with their karma.