Accelerometers are calibrated to read 0 in freefall, not at zero acceleration.
Once again, this isn't a question of calibration: an accelerometer measures the force due to acceleration. This is an absolute, not a relative value (Humber has spread some confusion with the idea of "absolute accelerometers": in fact
all accelerometers produce absolute measurements). The accelerometer cannot tell if the force is due to gravitational pull, rocket engine or some other source. An accelerometer will read zero when it experiences zero acceleration.
As Sol said, acceleration and gravity are equivalent: just by looking at the accelerometer, you can't tell if you're standing in a room at the surface of the earth or standing in a room that is being accelerated through space with a rocket engine.
If you want to make a simple accelerometer, just attach a known mass to the end of a spring scale. If the mass is 1 kg and the scale reads a weight of 1 kg (we need to be careful with "mass"' and 'weight", since we use the same units for both), the accelerometer is experiencing an acceleration of 1 g. If the scale is in a free fall situation (for instance if you hold it while jumping off a diving board) it will read zero weight, corresponding to zero acceleration.
How do you go from being in a supported elevator to one falling increasingly fast, and not be accelerating? How does it slow down, stop and come back again without accelerating?
Here again the equivalence of gravitational force and force due to acceleration comes into play. When the elevator is stationary with respect to the earth, it has to be supported by something that exerts an upward force on it exactly equivalent to its weight, to counteract the acceleration due to gravity. The accelerometer in the elevator reads 1 g in an upwards direction. As soon as this force is removed, the elevator is in a free fall situation. We see it start to accelerate at 1 g towards the centre of the earth: now the accelerometer inside reads zero.
For us surface-dwellers, who are used to the acceleration of 1 g we always feel through our feet, the elevator was stationary and is now accelerating. For the accelerometer, which cannot differentiate between gravitational acceleration and other acceleration, it was accelerating but is now no longer doing so.
As the elevator falls through the earth, here's what we on earth see: its speed increases but its acceleration decreases. When it reaches the centre of the earth, its speed is at a maximum but its acceleration is zero: at the centre of the earth gravitational force is zero. As soon as it goes past the centre of the earth, it starts being accelerated in the opposite direction, which causes it to slow down: it will continue to slow down (while its acceleration, in the opposite direction to that in which it is travelling, increases!), until it reaches the other end of the tunnel, at which point its acceleration is once more at 1 g but its speed is zero. Now its starts going back the other way.
The weird thing is that we see all these changes in acceleration, but the accelerometer inside the elevator always shows a value of zero. If you're using Newtonian mechanics to analyse this, you might say that at any point along the voyage, the "actual" acceleration of the elevator is producing a force in a direction away from the centre of the earth, that exactly counteracts the force of gravity towards the centre. This isn't surprising, since the "actual" acceleration is being directly produced by the force of gravity experienced at that point. If you're using general relativity to analyse the movement of the elevator, you'll say that it is following the shortest path in a region of space-time that is curved due to the mass of the earth.