If everybody in the world turned around tomorrow and said that agnosticism is a middle ground between theism and atheism I still wouldn't agree because such a statement is demonstrably wrong.
You might not think that using words that have actual meanings is important in discussion, but I do. So long as people are using 'agnosticism' as an ontological position between theism and atheism, I will be pointing out to them that it is no such thing, and that no position exists. While people are asserting that they hold a logically contradictory position, I will be pointing that out to them, and it is likely the discussion will not proceed further. This is not me being pedantic about things, this is because until people are claiming a position that is at least logically valid, it is meaningless to try and discuss the soundness of their position.
It is not the label I object to, it is the position itself. I wouldn't care if the position was described as 'fluffnostastic'. The fact that 'agnostic', a word that has a real, meaningful definition, has been hijacked with this nonsense is just another unfortunate happening - not my main issue.