This makes sense if all rights are created equal, but I think there's also a multiplier in that equation that accounts for the impact to both parties. This is where a lot of perception, emotion, subjective experience, bias etc. come into play and complicate things enormously. I think that's where this thread has hit an impasse many times; differing feelings on what constitutes minor vs major accommodation or concession or inconvenience or risk...
In my opinion, since the metrics for measurement of "impact" are highly personal and variable, it doesn't make sense to discuss it in terms of absolutes (e.g. one perspective is "right" and another "wrong"), but rather in terms of balance. This is tricky though, when things come down to a yes, or no decision (i.e. when solutions to accommodate both, as I agree with you, is an ideal solution, can't be immediately found) and when the balance point (in terms of numbers x impact per the perception of most people) is near the middle. This is further complicated when perceptions, understanding, data, etc. are changing at a rapid pace.