Statistical data from benchmark REG experiments, listed for passive calibrations (CAL); Operator high intentions
(HI), Low intentions (LO), and null intentions (BL); and HI–LO separations.
Parameter CAL HI LO BL HI–LO
Nt 5,803,354 839,800 836,650 820,750 1,676,450
μ 99.998 100.026 99.984 100.013
st 7.075 7.070 7.069 7.074
ss 0.002 0.006 0.006 0.006
dμ –0.002 0.026 –0.016 0.013 0.042
sμ 0.003 0.008 0.008 0.008 0.011
zμ –0.826 3.369 –2.016 1.713 3.809
pμ 0.409* 3.77 10–4 0.0219 0.0867* 6.99 10–5
S.I.D. 0.523 0.536 0.502† 0.569
O.I.D. 0.623 0.473 0.593† 0.516
KEY
Nt: Number of trials (200 binary samples each)
μ: Mean of trial score distribution
st: Standard deviation of trial score distribution
ss: Measurement uncertainty (statistical) in the observed value of
st ; ss s0/2Nt where s0 = 50 is the theoretical trial standard
deviation
dμ: Difference of mean from theoretical chance expectation;
dμ μ – μ0 for HI and LO;
dμ(HI – LO) μ(HI) – μ(LO) dμ(HI) – dμ(LO)
sμ: Measurement uncertainty (statistical) in the observed value of
dμ ; sμ = s0 /Nt for HI and LO;
sμ(HI – LO) = s01/Nt(HI) + 1/Nt(LO)
zμ: z-score of mean shift; zμ dμ/sμ (calculated with full precision
from raw data values, not from the rounded values presented
above in the table)
pμ: One-tail probability of zμ (CAL, BL two-tail)
S.I.D.: Proportion of series having zμ in the intended direction
O.I.D.: Proportion of operators with overall results in the intended
direction
* p-values for CAL and BL are two-tailed due to lack of intention.
† BL is treated as in intended direction when positive.