When someone cheats, why do people get mad at the third person rather than their partner?

I’ve always seen videos of people getting cheated on and always taking their anger on the third person rather than their partner who broke their bond. It’s just feel wrong to me, the other person maybe didn’t even knew they were in a relationship when they got with that person