It entirely depends on who says it.
If a complete random stranger on the internet says it, I give a grand total of zero craps. It is meaningless blather.
If a passing acquaintance that I'm not close friends with says it, well, they're enema-bags, and probably trying to hurt my feelings. They don't merit a response. They don't know what they're talking about and they're simply being childish.
If my spouse says it... well... that's different. That's hateful and cruel, and yes, it would hurt my feelings.
But that's exactly the point, isn't it? Mean words from strangers have no real power over you, and they don't justify a violent response. Even mean words from my spouse wouldn't justify a violent response, although they might possibly justify a divorce.