Military special-ops types have historically had access to "silenced" weapons that are pretty damned quiet. These were intended for assassinations or for sentry-removal. Among the ones I'm familiar with are a silenced High-Standard .22 rimfire pistol that was put together for the OSS.
According to legend, at least, "Wild Bill" Donovan demonstrated this in the Oval Office for the president and it was scarcely audible.
Also according to legend, some of these found their way to the hands of Jewish insurrectionists who used them to great effect against the British...
Another I'm familiar with was a single-shot .32 pistol which employed a supressor almost as large as the rest of the weapon...
Things to bear in mind is that supersonic bullets make noise quite independent of the weapon, a mini sonic-boom heard as a sharp crack when passing nearby.
Anyone who's been through the typical basic-training obstacle course will be familiar...
Also, reducing the report allows one to hear the usually rather loud cycling of the weapon if it's a semi-auto.
That's why the Berretta special-ops pistol has a slide lock for such work. One can engage the lock prior to firing, rendering the weapon a sort of repeater rather than a semi-auto.
As well, that's why "sub-sonic" rounds are normally employed in such weapons.