(Edited to add the two words in gray.)
In formal logic, validity means true under all interpretations.
For example,
Gödel's completeness theorem says every valid formula of standard first order logic is provable.
Which implies the existence of a
complete proof procedure for first order theories. Given any
recursively axiomatizable first order theory, we can write a computer program that will prove every valid consequence of the theory. In general, however, that computer program will not be a decision procedure: If you hand it a valid input, the program will (eventually!) respond with a proof of that input. If you hand it an invalid input, however, the program may just run forever as it tries to find a proof.
There is no decision procedure for standard first order logic. There is a simple decision procedure for propositional logic (e.g. truth tables).
All of the facts stated above have been proved with mathematical rigor, and are examples of using mathematics to prove facts about logic. Epistemologically, mathematics is how we gain knowledge about logic.
On the other hand, logic alone cannot provide a proof that mathematics is a reliable way to gain knowledge. Mathematics itself cannot even provide a proof of its own consistency. That's
Gödel's second incompleteness theorem. That incompleteness theorem is of course proved using mathematics, which is how we know it's true.
Why do we trust mathematics, when mathematics itself tells us it is impossible to prove the consistency of mathematics? That's where empiricism enters the picture. Mathematics is known to work quite reliably. If mathematics didn't work, virtually all modern science would be suspect. Science has an empirical foundation. The success of science counts as empirical evidence for mathematics.