I disagree.
When it comes to things understanding the world, we should be doing a Bayesian analysis of the risks we face. These should also be put in context, for instance the risk of an action should be compared to other possible actions, including inaction.
With respect to the vaccines, the risk of being vaccinated under such an analysis is extremely low. Much lower than the risks faced from not being vaccinated.
As such, the answer is extremely clear: there's no merit to the idea of not being vaccinated.
I realize that you're not trying to promote that view, but even suggesting that there's some merit to it "they have a point", isn't accurate. There really isn't any merit to that view.