The "radioactive dice" experiment is a commonly used classroom analogue to model the decay of radioactive nuclei. However, the value of the half-life obtained from this experiment differs significantly from that calculated for real nuclei decaying exponentially with the same decay constant. This article attempts to explain the discrepancy and suggests modifications to the experiment to minimize this effect. (Contains 2 tables and 2 figures.)