I said sexuality, not sex. These things are not synonymous. You might use he/she pronouns to refer to gender and not sex, but I don't. I use he/she pronouns to refer to sex. Not gender, and not sexuality.
And you didn't answer my question:
how does my use of pronouns interfere with their life?
No doubt if you see yourself as alone in the world and not a part of a larger society and its behavior, and your language as not representing anything about how you otherwise relate to the person, you're right. It doesn't have much effect. If it indicates, as it so often does, a bias that reflects how you interact with others, especially in a way that is transparently confrontational, it might, while not technically injurious, indicate further intent. After all, those in this thread who have objected to the use of preferred pronouns have been pretty explicit in their belief that transsexuals are delusional and mentally ill. So, yes, of course, in the world of the context-free solipsist, if you simply call a person insane, without any further action, it's just nasty. No sticks and stones.
But from the point of view of the person receiving pronouns purposely contrary to their stated preference, you might, despite any disavowal of statistics and protestations of separation from others who do the very same thing, be seen as a member of a group for whom the speech is only one symptom of a variety of attitudes toward their place in society and their ability to lead the lives they seek.
Your question is like asking what harm there is in flying a Confederate flag. You might be able to say it does nothing, but you'd be a tone-deaf fool to say it
says nothing. And that, of course, is true even if you contend that what you're saying is right, and it's true even if you are right in saying so. If you try too diligently to contend that your speech is inconsequential, you might end up robbing yourself of an argument for doing it.