Oh, I don't doubt you believe this. But if, historically, the only entities violating one's rights are human (either individually or collectively), does not that imply that functionally speaking, these rights exist at the behest of humans? Tell me when god or nature has taken back these rights--you assume it is theirs to give (and presumably, deny), but the only times I see rights violated, it is by people. In practical terms, then, it is people who give us our rights, and we enjoy them only because others do not impose their will on ours.
(oh, and be careful about saying that the only way a right can be violated is through the application of force--you may or may not be technically correct, but it does sound a bit much like "threat of force", when of course we may manipulate you even easier through reward than through punishment! People line up to give their money to the government...when it is the lottery, instead of taxes...and yes, I understand that the lottery may be seen as an application of force, which is why I said "may or may not be...")