I think you could, potentially reduce the pool of firearms over time. It depends, of course, on how permeable the US border is. My understanding, based on findings post 9/11, is that US border protection is appalling. I think a notable thing about many of these other countries that have low levels of gun use in crime is that they have quite robust border protection. This highlights the fact that "gun control" is about something vastly more complex than "bad assault weapons" or something reactionary like that. Ultimately, the issue with gun crime is people having access to weapons to use them illegally. So the principal question is how you can limit access by these people to said guns with minimal restriction in access to guns by non-criminal users. Gun control measures that don't limit access to guns by these groups are pointless. If they limit access by legitimate users as well, they're doubly pointless, or have negative "point" if you will.
A notable thing about many countries with stringent gun control laws is that these strict laws came in after gun crime reached a high state, and society decided to address it. High numbers of guns were already in circulation when these controls were brought in, and while new control laws cut the inflow, that in itself doesn't do a whole lot.
What all of these countries also did was really work hard on seizing guns too. In a country like New Zealand, if a firearm is discovered in the context of any sort of offending, there is no warning. The weapon is seized, period, and a firearm license revoked (if you have one).
Even though firearms are used in a tiny fraction of crimes in this country, thousands of firearms are seized by police every year. If police seize more than criminals are able to get their hands on, you reduce the pool of firearms. It's very much a two-pronged assault - you have to reduce access to firearms by people who will use them criminally (and gun control laws are really only part of that approach), but you also have to take guns off the street at the other end too.