ELI5: why do buttons and zippers on women’s clothes go one way and the other way on men’s?

It’s like right and left handed scissors but for clothes. Why does it matter?